-- Logs begin at Tue 2022-09-06 03:43:56 UTC, end at Tue 2022-09-06 04:39:19 UTC. -- Sep 06 04:08:24.562046 dv-cinder-856002-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 06 04:08:24.569349 dv-cinder-856002-1-smb devstack@keystone.service[81613]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 06 04:08:24.571347 dv-cinder-856002-1-smb devstack@keystone.service[81613]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 04:08:24 2022] *** Sep 06 04:08:24.571347 dv-cinder-856002-1-smb devstack@keystone.service[81613]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 04:08:24.571347 dv-cinder-856002-1-smb devstack@keystone.service[81613]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 04:08:24.571347 dv-cinder-856002-1-smb devstack@keystone.service[81613]: nodename: dv-cinder-856002-1-smb Sep 06 04:08:24.571347 dv-cinder-856002-1-smb devstack@keystone.service[81613]: machine: x86_64 Sep 06 04:08:24.571347 dv-cinder-856002-1-smb devstack@keystone.service[81613]: clock source: unix Sep 06 04:08:24.571347 dv-cinder-856002-1-smb devstack@keystone.service[81613]: pcre jit disabled Sep 06 04:08:24.571825 dv-cinder-856002-1-smb devstack@keystone.service[81613]: detected number of CPU cores: 4 Sep 06 04:08:24.571825 dv-cinder-856002-1-smb devstack@keystone.service[81613]: current working directory: / Sep 06 04:08:24.571825 dv-cinder-856002-1-smb devstack@keystone.service[81613]: detected binary path: /usr/bin/uwsgi-core Sep 06 04:08:24.573935 dv-cinder-856002-1-smb devstack@keystone.service[81613]: your processes number limit is 47680 Sep 06 04:08:24.573935 dv-cinder-856002-1-smb devstack@keystone.service[81613]: your memory page size is 4096 bytes Sep 06 04:08:24.573935 dv-cinder-856002-1-smb devstack@keystone.service[81613]: detected max file descriptor number: 2048 Sep 06 04:08:24.573935 dv-cinder-856002-1-smb devstack@keystone.service[81613]: lock engine: pthread robust mutexes Sep 06 04:08:24.573935 dv-cinder-856002-1-smb devstack@keystone.service[81613]: thunder lock: enabled Sep 06 04:08:24.573935 dv-cinder-856002-1-smb devstack@keystone.service[81613]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 06 04:08:24.573935 dv-cinder-856002-1-smb devstack@keystone.service[81613]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 04:08:24.612392 dv-cinder-856002-1-smb devstack@keystone.service[81613]: Python main interpreter initialized at 0x55a39f1849c0 Sep 06 04:08:24.612392 dv-cinder-856002-1-smb devstack@keystone.service[81613]: python threads support enabled Sep 06 04:08:24.612392 dv-cinder-856002-1-smb devstack@keystone.service[81613]: your server socket listen backlog is limited to 100 connections Sep 06 04:08:24.612392 dv-cinder-856002-1-smb devstack@keystone.service[81613]: your mercy for graceful operations on workers is 90 seconds Sep 06 04:08:24.612768 dv-cinder-856002-1-smb devstack@keystone.service[81613]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 04:08:24.612848 dv-cinder-856002-1-smb devstack@keystone.service[81613]: *** Operational MODE: preforking *** Sep 06 04:08:24.613089 dv-cinder-856002-1-smb devstack@keystone.service[81613]: *** uWSGI is running in multiple interpreter mode *** Sep 06 04:08:24.613089 dv-cinder-856002-1-smb devstack@keystone.service[81613]: spawned uWSGI master process (pid: 81613) Sep 06 04:08:24.613295 dv-cinder-856002-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 06 04:08:24.614104 dv-cinder-856002-1-smb devstack@keystone.service[81613]: spawned uWSGI worker 1 (pid: 81626, cores: 1) Sep 06 04:08:24.614202 dv-cinder-856002-1-smb devstack@keystone.service[81613]: spawned uWSGI worker 2 (pid: 81627, cores: 1) Sep 06 04:08:24.616382 dv-cinder-856002-1-smb devstack@keystone.service[81613]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 04:08:28.882583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:08:28.882583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: from cryptography.utils import int_from_bytes Sep 06 04:08:28.883413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:08:28.883413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: from cryptography.utils import int_from_bytes Sep 06 04:08:28.883873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:08:28.883873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: from cryptography.utils import int_from_bytes Sep 06 04:08:28.884000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:08:28.884000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: from cryptography.utils import int_from_bytes Sep 06 04:08:28.933060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 04:08:28.933259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 04:08:28.933364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 04:08:28.933452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] command line args: [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 04:08:28.933530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 04:08:28.933646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] command line args: [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 04:08:28.933729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 04:08:28.933860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ================================================================================ {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 04:08:28.933938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 04:08:28.934089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ================================================================================ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 04:08:28.934172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] admin_token = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.934348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] config_dir = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.934437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] admin_token = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.934537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.934620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_dir = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.934718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] config_source = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.934800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.934949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] debug = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.935580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_source = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.935676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.936934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] debug = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.936934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.937935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] list_limit = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] log_config_append = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_config_append = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] log_dir = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_dir = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] log_file = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938901 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.938975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.939939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.940944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] publish_errors = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.941911 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] publish_errors = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942483 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] standard_threads = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.942940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] standard_threads = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] use_journal = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] use_json = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_journal = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.943932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] use_stderr = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.944006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_json = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.944081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] use_syslog = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.944150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_stderr = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.944264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_syslog = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.944342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.944500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:08:28.944576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.944758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.944834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.945965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946685 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.946931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947166 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.947996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.948967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.949938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.950917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.951903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.952997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.953914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.954834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.955913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.956943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.957980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.958982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.959982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.960975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.961929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962639 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.962964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.963923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.964882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965122 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.965864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.966983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.967939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.968959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] auth.external = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.969930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.external = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] auth.password = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.970906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.password = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] auth.token = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.token = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.971881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.972980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] credential.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.973960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.974925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.975949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.976940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.977976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.978929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.979919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.980881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.981044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.981129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.981273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.981350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.981511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.981588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.982294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.982381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.982548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.982623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.982782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.982858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.983825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.984997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.985996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.986940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.987950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.988877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.989963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.990048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.990199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.990276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.990435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.990512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.990684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.990791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.991919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.992953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.993025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.993094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.993156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.993221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.995701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.995800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.995865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.995940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.996970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.997027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.997096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.997157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.997215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.997274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.998792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.998940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.999072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.999200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.999328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.999494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.999616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.999746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:28.999874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.000907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.001282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.001407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.001542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.001667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.001792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.001918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.002939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.003995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.004934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.005966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] role.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] role.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.006976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007197 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.007946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.008989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.009160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.009239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.009413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.009490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.009645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.009730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.009901 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.010944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.011905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.012940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.013897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.014937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.015899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.016972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.connection = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.017918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.018966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.019937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.020986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.021100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.021214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.021328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.021449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 04:08:29.021565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.021679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:08:29.021792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 04:08:29.050558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.050787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.051011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.051095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.051269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.051525 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.059265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.059821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.087482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.087705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.087891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.088125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.141095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.141449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.189824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.190053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.190388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.190624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.345580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.345813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.346042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.346263 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.346483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.346701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.346783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.346965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.347187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.347423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.347642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.347856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.370994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.371084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.371209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.371290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.371444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.371527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.371659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.382892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.389643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.395646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.395828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.396056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.396283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.396505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.396725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.396943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.400397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.400627 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.400854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.401078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.401294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.401504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.401714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81627) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 04:08:29.413956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.414169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 04:08:29.414515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.414642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.414739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 04:08:29.414853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 04:08:29.414983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.415191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.415274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.415408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 04:08:29.415531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.415687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.415794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.415947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.416206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.416463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.425957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.426244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.426518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.426622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.426805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.426905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.427160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.427466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.433785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.434396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.436746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.437033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.437316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.437399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.437601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.437684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.437883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.437966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.438144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.438226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.438415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.438506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.438678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.438760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.438944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.439025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.439218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.439301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.439513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.439596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.439789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.440055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.462100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.462453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.463593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.463882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.463963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.464209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.469106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.469380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.469463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.469665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.469759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.469943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.476003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.476267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.476350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.476554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.482440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.482726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.482810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.483985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.484155 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.484238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.484424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.484505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.484692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.499906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.500042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.500188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.500312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.504350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.504488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.507608 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.507702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.507907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.507991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.512132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.512225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.515260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.515344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.518619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.518716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.518919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.519001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.519205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.519287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.519510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.519594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.519795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.519877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.520083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.520177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.536190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.536361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.536487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.536660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.536740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.536934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.537019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.537207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.543768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.544068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.545874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.546182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.547412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.547694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.547776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.548020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.550309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.550596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.550769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.550886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.551058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.551173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.551419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.551647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.551742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.552084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.562718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.563004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.563272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.563355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.563575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.563669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.563859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.563941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.564146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.564229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.564474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.564557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.564809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.565095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.579754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.580435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.582636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.583335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.585525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.586257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.586956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.587732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.588458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.588741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.589136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.589218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.589490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.589888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.595981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.596765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.597428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.598222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.600323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.600722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.601011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.601136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.601300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.601538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.601830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.602115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.609569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.609868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.610158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.610423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.610733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.611029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.616954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81627) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.617241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.617522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.617796 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.617913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 04:08:29.618074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.618202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.618344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.618489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.618613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.618771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.618897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.619064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.619156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.619343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.619450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.619652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.619737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.619941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.620022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.620218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.620308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.620482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81627) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.620563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.620766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.621045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.621315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.621578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 04:08:29.655020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a39f1849c0 pid: 81627 (default app) Sep 06 04:08:29.656621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a39f1849c0 pid: 81626 (default app) Sep 06 04:08:29.658302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423fc48-3719-449f-974b-9cec94e9a652 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:29.658587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423fc48-3719-449f-974b-9cec94e9a652 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:29.658857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423fc48-3719-449f-974b-9cec94e9a652 None None] PATH_INFO: `/v3` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:29.669001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Sep 6 04:08:29 2022] GET /identity/v3/ => generated 255 bytes in 13 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:36.248066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6133-bfe2-4efc-a585-052e2e6edcba None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:36.248541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6133-bfe2-4efc-a585-052e2e6edcba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:36.248541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6133-bfe2-4efc-a585-052e2e6edcba None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:36.253146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:08:36.258342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:36.258734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:36.258871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:36.329661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: INFO dbcounter [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] Registered counter for database keystone Sep 06 04:08:36.348735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG oslo_db.sqlalchemy.engines [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:08:36.354880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writer thread running {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:08:36.534419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG passlib.handlers.bcrypt [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81627) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 04:08:36.534720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG passlib.handlers.bcrypt [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81627) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 04:08:36.592737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:36.594339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:36.722856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 04:08:37.215899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6133-bfe2-4efc-a585-052e2e6edcba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:37.286162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: INFO dbcounter [None req-d8cc6133-bfe2-4efc-a585-052e2e6edcba None None] Registered counter for database keystone Sep 06 04:08:37.307706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG oslo_db.sqlalchemy.engines [None req-d8cc6133-bfe2-4efc-a585-052e2e6edcba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:08:37.314630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writer thread running {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:08:37.433138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6133-bfe2-4efc-a585-052e2e6edcba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:37.438032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696522f0-4c17-4cce-bcd5-891219feb831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:37.438660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696522f0-4c17-4cce-bcd5-891219feb831 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:37.438939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696522f0-4c17-4cce-bcd5-891219feb831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:37.439210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696522f0-4c17-4cce-bcd5-891219feb831 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:37.447359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696522f0-4c17-4cce-bcd5-891219feb831 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:37.498842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING keystone.common.rbac_enforcer.enforcer [None req-696522f0-4c17-4cce-bcd5-891219feb831 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 04:08:37.499189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696522f0-4c17-4cce-bcd5-891219feb831 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:37.508823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Sep 6 04:08:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:08:37.514784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:37.529138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b800cf0-9b07-4337-9719-52f2b7c8dfa2 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:37.533564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233de53-e321-489e-b790-bae76246cfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:37.534652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233de53-e321-489e-b790-bae76246cfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:37.534934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233de53-e321-489e-b790-bae76246cfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:37.535205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233de53-e321-489e-b790-bae76246cfe6 admin admin] PATH_INFO: `/v3/projects/e7e04b96ebc74904845e65316dbf81fa` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:37.536873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233de53-e321-489e-b790-bae76246cfe6 admin admin] RBAC: Authorizing `identity:get_project(project_id=e7e04b96ebc74904845e65316dbf81fa)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:37.590144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b233de53-e321-489e-b790-bae76246cfe6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 04:08:37.590490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233de53-e321-489e-b790-bae76246cfe6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:37.595672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Sep 6 04:08:37 2022] GET /identity/v3/projects/e7e04b96ebc74904845e65316dbf81fa => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:39.492919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1292b-cca9-4eb3-97ac-091e3679e1dd None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:39.493459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1292b-cca9-4eb3-97ac-091e3679e1dd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:39.493459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1292b-cca9-4eb3-97ac-091e3679e1dd None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:39.497659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:39.503255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8465b5-b674-44d2-9210-9dc4ea8b91a8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:39.503663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8465b5-b674-44d2-9210-9dc4ea8b91a8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:39.503854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8465b5-b674-44d2-9210-9dc4ea8b91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:39.524047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-db8465b5-b674-44d2-9210-9dc4ea8b91a8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:39.525571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-db8465b5-b674-44d2-9210-9dc4ea8b91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:39.533953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 04:08:39.801696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1292b-cca9-4eb3-97ac-091e3679e1dd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:39.814251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1292b-cca9-4eb3-97ac-091e3679e1dd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:39.818455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31e900-d17b-4494-b4d7-51491e84c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:39.819050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31e900-d17b-4494-b4d7-51491e84c91e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:39.819330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31e900-d17b-4494-b4d7-51491e84c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:39.819631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31e900-d17b-4494-b4d7-51491e84c91e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:39.827725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31e900-d17b-4494-b4d7-51491e84c91e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:39.829490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31e900-d17b-4494-b4d7-51491e84c91e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:39.838089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Sep 6 04:08:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 04:08:39.843250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8465b5-b674-44d2-9210-9dc4ea8b91a8 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:39.852189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8465b5-b674-44d2-9210-9dc4ea8b91a8 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:39.856410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fd958-9d3b-4c3a-818e-f5038f6bcc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:39.857029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd958-9d3b-4c3a-818e-f5038f6bcc64 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:39.857305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd958-9d3b-4c3a-818e-f5038f6bcc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:39.857574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd958-9d3b-4c3a-818e-f5038f6bcc64 admin admin] PATH_INFO: `/v3/users/6fc7d729120c446b975c63cfa06003cb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:39.858866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fd958-9d3b-4c3a-818e-f5038f6bcc64 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fc7d729120c446b975c63cfa06003cb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:39.860718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fd958-9d3b-4c3a-818e-f5038f6bcc64 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:39.862209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Sep 6 04:08:39 2022] GET /identity/v3/users/6fc7d729120c446b975c63cfa06003cb => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:41.791743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608c63-3f9f-4bc1-bff5-7f8c7b6ebd99 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:41.792278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608c63-3f9f-4bc1-bff5-7f8c7b6ebd99 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:41.792278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608c63-3f9f-4bc1-bff5-7f8c7b6ebd99 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:41.793615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:41.799208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e281b-28a2-465f-b5ab-188c83df74d6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:41.799664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e281b-28a2-465f-b5ab-188c83df74d6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:41.799808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e281b-28a2-465f-b5ab-188c83df74d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:41.818115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d10e281b-28a2-465f-b5ab-188c83df74d6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:41.819321 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d10e281b-28a2-465f-b5ab-188c83df74d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:41.854534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69055a-c6d9-49ea-a95f-9a1f54c6c6d5 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:41.854813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69055a-c6d9-49ea-a95f-9a1f54c6c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:41.855089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69055a-c6d9-49ea-a95f-9a1f54c6c6d5 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:41.856634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:08:41.861860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:41.862145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:41.862433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:41.900933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:41.904656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG passlib.handlers.bcrypt [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81626) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 04:08:41.905050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG passlib.handlers.bcrypt [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81626) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 04:08:41.955161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:41.956779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:42.059164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:42.172740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e281b-28a2-465f-b5ab-188c83df74d6 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.197813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:42.277563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e281b-28a2-465f-b5ab-188c83df74d6 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.309467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.310027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.310300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.310566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.321766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:08:42.329985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:08:42.331148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:42.332192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:08:42.333199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:08:42.337833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.417939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:42.441402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f89ef-bed6-4db4-9a03-d3b14c5eeee3 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.442495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bc506-dd9d-4323-adb4-4f07ec906dc6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.444896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:42.477254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.477862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.478141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.478412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.479075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:42.479393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:42.480432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.480790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:42.481299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.481587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.481863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.492967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:42.499103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.548938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:42.550463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:42.598414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7532b7-962d-49e7-9fdb-101afd2c8445 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.632202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.632823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.633101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.633374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] PATH_INFO: `/v3/users/6fc7d729120c446b975c63cfa06003cb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.634509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=6fc7d729120c446b975c63cfa06003cb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:42.635998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:42.637551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 9/16] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/users/6fc7d729120c446b975c63cfa06003cb => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:42.643145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.646095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:08:42.651358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.654057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:42.657868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:42.741859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363f02-fca7-444f-82bd-9f621ca0a0b6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.751252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343882-a573-4ca4-8d10-2e05bc421afc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.775497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.776124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.776404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.776675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.777794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:42.779239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:42.780846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:42.786552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.789575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.790429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.790711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.790986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.809923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:42.811984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:08:42.829901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:42.830824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:08:42.831640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:08:42.831640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:08:42.831640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:08:42.831640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:08:42.836665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:42.867593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:42.887521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df5bb0-c951-49ca-a4f1-725f9ebbd068 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.894515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:42.921186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4c8b1-db93-4a2a-b463-6381203ca255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.921789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4c8b1-db93-4a2a-b463-6381203ca255 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.922070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4c8b1-db93-4a2a-b463-6381203ca255 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.922350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4c8b1-db93-4a2a-b463-6381203ca255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.923072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4c8b1-db93-4a2a-b463-6381203ca255 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.domain.id=default, user.id=6fc7d729120c446b975c63cfa06003cb) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:42.923396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4c8b1-db93-4a2a-b463-6381203ca255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:42.924853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4c8b1-db93-4a2a-b463-6381203ca255 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:42.931433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/role_assignments?user.id=6fc7d729120c446b975c63cfa06003cb&scope.domain.id=default&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:42.939971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d7528-3195-4137-a2a5-270f5dba2e26 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:42.976409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3740922-3136-422d-aa22-03e407d77408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:42.977040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740922-3136-422d-aa22-03e407d77408 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:42.977322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740922-3136-422d-aa22-03e407d77408 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:42.977595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740922-3136-422d-aa22-03e407d77408 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:42.978268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3740922-3136-422d-aa22-03e407d77408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:42.978574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3740922-3136-422d-aa22-03e407d77408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:42.980065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3740922-3136-422d-aa22-03e407d77408 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:43.000598 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:45.383315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703e19-c474-4f33-8dbb-dde8b97fa50b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.384284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703e19-c474-4f33-8dbb-dde8b97fa50b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.384758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703e19-c474-4f33-8dbb-dde8b97fa50b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.386283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:45.393030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c31bd-11d9-4dbd-8cbd-506382505bd7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.393848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c31bd-11d9-4dbd-8cbd-506382505bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.394419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c31bd-11d9-4dbd-8cbd-506382505bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.428684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f57c31bd-11d9-4dbd-8cbd-506382505bd7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:45.430207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f57c31bd-11d9-4dbd-8cbd-506382505bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:45.513376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:45.556970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026594-15e7-4281-ac4b-ac6264618c42 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.557668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026594-15e7-4281-ac4b-ac6264618c42 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.558140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026594-15e7-4281-ac4b-ac6264618c42 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.559689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:08:45.565664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd7e0-5860-4671-93ed-e7315b4d4b2a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.566196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd7e0-5860-4671-93ed-e7315b4d4b2a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.567984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4f07-1173-4942-9630-5a85970a375a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.568459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4f07-1173-4942-9630-5a85970a375a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.568918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4f07-1173-4942-9630-5a85970a375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.572092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd7e0-5860-4671-93ed-e7315b4d4b2a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.574071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 12/25] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:45.583149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d396-bace-4592-82d1-346fff5cb329 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.584623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d396-bace-4592-82d1-346fff5cb329 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.585100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d396-bace-4592-82d1-346fff5cb329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.601558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-70da4f07-1173-4942-9630-5a85970a375a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:45.603888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-70da4f07-1173-4942-9630-5a85970a375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:45.623807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e390d396-bace-4592-82d1-346fff5cb329 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:45.625316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e390d396-bace-4592-82d1-346fff5cb329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:45.707139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:45.747047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 14/26] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:45.750259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d460ad0-7e96-4dfa-9cdb-f7130d055678 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.751773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d460ad0-7e96-4dfa-9cdb-f7130d055678 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.752058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d460ad0-7e96-4dfa-9cdb-f7130d055678 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.753161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:45.754193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:45.765400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a0376-3634-4ae0-989d-ce5aaac3ed90 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:45.765799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a0376-3634-4ae0-989d-ce5aaac3ed90 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:45.766176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a0376-3634-4ae0-989d-ce5aaac3ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:45.795571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-246a0376-3634-4ae0-989d-ce5aaac3ed90 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:45.796949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-246a0376-3634-4ae0-989d-ce5aaac3ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:45.888225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 14/29] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:08:45.904343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d460ad0-7e96-4dfa-9cdb-f7130d055678 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:46.016683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:46.055973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d460ad0-7e96-4dfa-9cdb-f7130d055678 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:46.106814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:46.107872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.108345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.108828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.120754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:46.127393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:08:46.152012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:46.152917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:08:46.154341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:08:46.154341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:08:46.154341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:08:46.154341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 16/30] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:08:46.159342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a0376-3634-4ae0-989d-ce5aaac3ed90 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:46.211064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:46.318974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614620c-314e-4b58-986a-6f529fb1cd96 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:46.337417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a0376-3634-4ae0-989d-ce5aaac3ed90 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:46.344922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:46.346474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:46.355887 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:46.356745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.357244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.357775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.359448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:46.361058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:46.376072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:46.376689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.377175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.377360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.378612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:46.378906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:46.380321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:46.392133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:46.392933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:46.493260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec8be5-fddc-4d30-8a64-c14ac3e15a87 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:46.497986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 17/32] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Sep 6 04:08:46 2022] POST /identity/v3/roles => generated 219 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:08:46.500294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:46.562192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a104c77-5c26-4453-a513-045c679f93f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:46.563163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a104c77-5c26-4453-a513-045c679f93f5 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.565489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a104c77-5c26-4453-a513-045c679f93f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.565992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a104c77-5c26-4453-a513-045c679f93f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.566946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a104c77-5c26-4453-a513-045c679f93f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:46.569802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a104c77-5c26-4453-a513-045c679f93f5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:46.669431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ae85-cfaa-4303-b5ef-0e7bd41805b8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:46.707820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:46.708667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.708951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.709226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.720505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:08:46.725554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:46.726389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:08:46.727145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:08:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:08:46.728362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:46.736840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 16/34] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Sep 6 04:08:46 2022] POST /identity/v3/roles => generated 225 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:08:46.738686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3624d-4476-4c35-86b4-f60ee25f58fb None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.739205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3624d-4476-4c35-86b4-f60ee25f58fb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.739716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3624d-4476-4c35-86b4-f60ee25f58fb None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.741233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 17/35] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:46.742200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3624d-4476-4c35-86b4-f60ee25f58fb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:46.778873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:46.799833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:46.862929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4bff6-ecea-4a73-b319-b964065707a6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:46.863921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3624d-4476-4c35-86b4-f60ee25f58fb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:46.904331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767b5af-f016-4db7-845f-cacd04bbc357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:46.905616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633859c-650c-49ae-b953-a9e043b0e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:46.905762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767b5af-f016-4db7-845f-cacd04bbc357 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.905762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767b5af-f016-4db7-845f-cacd04bbc357 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.905904 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633859c-650c-49ae-b953-a9e043b0e97b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.905999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767b5af-f016-4db7-845f-cacd04bbc357 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.906066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633859c-650c-49ae-b953-a9e043b0e97b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.906066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633859c-650c-49ae-b953-a9e043b0e97b None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.906237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767b5af-f016-4db7-845f-cacd04bbc357 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:46.906564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633859c-650c-49ae-b953-a9e043b0e97b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:46.906868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633859c-650c-49ae-b953-a9e043b0e97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:46.908421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633859c-650c-49ae-b953-a9e043b0e97b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:46.908861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767b5af-f016-4db7-845f-cacd04bbc357 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:46.923043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:08:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:46.924340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ac25b-4963-4132-8736-81a41b8d0d57 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.924637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ac25b-4963-4132-8736-81a41b8d0d57 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.924914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ac25b-4963-4132-8736-81a41b8d0d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.945092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:08:46 2022] POST /identity/v3/projects => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:08:46.946442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463892f3-9f3d-464e-961e-1d5c47bf0ea7 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:46.946724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463892f3-9f3d-464e-961e-1d5c47bf0ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:46.947001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463892f3-9f3d-464e-961e-1d5c47bf0ea7 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:46.947224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a63ac25b-4963-4132-8736-81a41b8d0d57 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:46.948642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 20/38] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:46.948878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a63ac25b-4963-4132-8736-81a41b8d0d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:46.949404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463892f3-9f3d-464e-961e-1d5c47bf0ea7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:47.030566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 19/39] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:47.032109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ab37-e8f0-4a75-9233-1b3cea920d49 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:47.032466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ab37-e8f0-4a75-9233-1b3cea920d49 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:47.032816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ab37-e8f0-4a75-9233-1b3cea920d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:47.056561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ef00ab37-e8f0-4a75-9233-1b3cea920d49 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:47.057914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ef00ab37-e8f0-4a75-9233-1b3cea920d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:47.075008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:47.152701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 20/40] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:47.214656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:47.220649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463892f3-9f3d-464e-961e-1d5c47bf0ea7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:47.257142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:47.257762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:47.258038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:47.258304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] PATH_INFO: `/v3/users/6fc7d729120c446b975c63cfa06003cb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:47.259433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] RBAC: Authorizing `identity:get_user(user_id=6fc7d729120c446b975c63cfa06003cb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:47.260874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:47.262624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 21/41] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:08:46 2022] GET /identity/v3/users/6fc7d729120c446b975c63cfa06003cb => generated 247 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:47.268226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00ab37-e8f0-4a75-9233-1b3cea920d49 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:47.309188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:47.380019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00ab37-e8f0-4a75-9233-1b3cea920d49 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:47.416855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:47.417428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f0634-6972-4f5a-afbc-d6d7182116ed None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:47.417555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:47.417735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:47.418008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:47.421204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:47.422688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:47.424418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 21/42] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:47.425015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:47.444457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:47.451749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:47.452378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:47.452653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:47.452923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:47.454032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:47.455490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:47.457035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:47.457763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:47.492628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:47.528528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396de3fd-06fa-45d3-bbc7-3fa8e012cf51 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:47.558719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914407-d5c1-441b-bc9b-61a8144e426c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:47.561768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:47.562374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:47.562651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:47.562919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:47.563616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:47.564989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:47.578817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Sep 6 04:08:47 2022] POST /identity/v3/roles => generated 223 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:08:47.579613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:47.594502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37ea50-2a64-4e99-b8cb-f39f98e75001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:47.595548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37ea50-2a64-4e99-b8cb-f39f98e75001 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:47.595836 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37ea50-2a64-4e99-b8cb-f39f98e75001 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:47.596124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37ea50-2a64-4e99-b8cb-f39f98e75001 None admin] PATH_INFO: `/v3/domains/default/users/6fc7d729120c446b975c63cfa06003cb/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:47.598372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37ea50-2a64-4e99-b8cb-f39f98e75001 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6fc7d729120c446b975c63cfa06003cb, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:47.599943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37ea50-2a64-4e99-b8cb-f39f98e75001 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:47.615714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 23/45] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Sep 6 04:08:47 2022] PUT /identity/v3/domains/default/users/6fc7d729120c446b975c63cfa06003cb/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:08:47.672859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:47.701343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8035-17ce-46a6-8697-9743e979d69a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:47.742208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64385f-d94c-4091-b9d5-b2fc53742685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:47.742842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64385f-d94c-4091-b9d5-b2fc53742685 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:47.743135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64385f-d94c-4091-b9d5-b2fc53742685 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:47.743501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64385f-d94c-4091-b9d5-b2fc53742685 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:47.744174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64385f-d94c-4091-b9d5-b2fc53742685 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:47.745676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64385f-d94c-4091-b9d5-b2fc53742685 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:47.779528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:08:47 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:08:49.526856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe609bb-1d08-47ff-8098-7e8abb5816f7 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:49.527365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe609bb-1d08-47ff-8098-7e8abb5816f7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:49.527503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe609bb-1d08-47ff-8098-7e8abb5816f7 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:49.528935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:49.534401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c425f-eda6-4ca3-b1c4-098030903e14 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:49.534794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c425f-eda6-4ca3-b1c4-098030903e14 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:49.535118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c425f-eda6-4ca3-b1c4-098030903e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:49.553701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fe3c425f-eda6-4ca3-b1c4-098030903e14 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:49.554895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fe3c425f-eda6-4ca3-b1c4-098030903e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:49.678046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48736-fb31-403b-8514-1f2ebc0ee077 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:49.678330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48736-fb31-403b-8514-1f2ebc0ee077 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:49.678611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48736-fb31-403b-8514-1f2ebc0ee077 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:49.680002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 25/48] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:08:49.685392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25487-ba25-477a-818e-37817b169a70 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:49.685708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25487-ba25-477a-818e-37817b169a70 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:49.685983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25487-ba25-477a-818e-37817b169a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:49.705607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-dff25487-ba25-477a-818e-37817b169a70 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:49.707136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-dff25487-ba25-477a-818e-37817b169a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:49.722836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 24/49] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:49.780072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 26/50] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:08:49.998823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c425f-eda6-4ca3-b1c4-098030903e14 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:50.047086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25487-ba25-477a-818e-37817b169a70 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:50.057181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:50.074968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:50.104442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c425f-eda6-4ca3-b1c4-098030903e14 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:50.138853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:50.140027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:50.140306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:50.140576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:50.151601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:08:50.158725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:50.159741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:08:50.160517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 25/51] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:08:50.165285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25487-ba25-477a-818e-37817b169a70 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:50.165577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:50.198720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:50.199468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:50.199751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:50.200021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:50.201135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:50.203129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:50.204872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 27/52] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:50.210155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:50.262594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949ded8-e1f3-4e9c-abe3-c9cbf35468cf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:50.280669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:50.299350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:50.299549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:50.300137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:50.300484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:50.300803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:50.301566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:50.301928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:50.303360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:50.309022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82c8d5-2008-4a31-974e-23d62afad807 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:50.311922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:50.317749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:50.343288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:50.343916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:50.344196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:50.344467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:50.345115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:50.346545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:50.373230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 28/54] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Sep 6 04:08:50 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:08:50.423864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99e63-6719-4477-9ce6-07929a4514be None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:50.471059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:50.471744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:50.472032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:50.472310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] PATH_INFO: `/v3/users/6fc7d729120c446b975c63cfa06003cb` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:50.473733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] RBAC: Authorizing `identity:get_user(user_id=6fc7d729120c446b975c63cfa06003cb)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:50.475226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:50.476908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:08:50 2022] GET /identity/v3/users/6fc7d729120c446b975c63cfa06003cb => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:08:50.482695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:50.582062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721d71-cc38-4008-a852-89ecc2c56561 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:50.614217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9037-e615-441e-90b9-b0ad17cb77fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:50.614839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9037-e615-441e-90b9-b0ad17cb77fe None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:50.615114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9037-e615-441e-90b9-b0ad17cb77fe None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:50.615403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9037-e615-441e-90b9-b0ad17cb77fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:50.616493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9037-e615-441e-90b9-b0ad17cb77fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:50.617927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9037-e615-441e-90b9-b0ad17cb77fe None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:50.619501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:50.625831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:50.674434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:50.726375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7845f0-375e-4a17-8204-f94583e61636 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:50.760885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c4957-a99a-4280-94bc-54365492fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:50.761489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4957-a99a-4280-94bc-54365492fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:50.761772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4957-a99a-4280-94bc-54365492fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:50.762046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4957-a99a-4280-94bc-54365492fdc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:50.762772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c4957-a99a-4280-94bc-54365492fdc6 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.domain.id=default, user.id=6fc7d729120c446b975c63cfa06003cb) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:50.763081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c4957-a99a-4280-94bc-54365492fdc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:50.765077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c4957-a99a-4280-94bc-54365492fdc6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:50.774404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Sep 6 04:08:50 2022] GET /identity/v3/role_assignments?user.id=6fc7d729120c446b975c63cfa06003cb&scope.domain.id=default&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:52.281544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23ed9-2e98-41de-a87a-cd0bdd3b28e0 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:52.282054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23ed9-2e98-41de-a87a-cd0bdd3b28e0 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:52.282054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23ed9-2e98-41de-a87a-cd0bdd3b28e0 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:52.283345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:52.288350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e75b-3140-4c68-ab8a-51b8f1366a97 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:52.288760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e75b-3140-4c68-ab8a-51b8f1366a97 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:52.288906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e75b-3140-4c68-ab8a-51b8f1366a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:52.307924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b164e75b-3140-4c68-ab8a-51b8f1366a97 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:52.309127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b164e75b-3140-4c68-ab8a-51b8f1366a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:52.373661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:52.651361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23ed9-2e98-41de-a87a-cd0bdd3b28e0 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:52.666643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:52.753687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23ed9-2e98-41de-a87a-cd0bdd3b28e0 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:52.785985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dd203-92f5-4a0f-8a23-779a900ec38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:52.786605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd203-92f5-4a0f-8a23-779a900ec38b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:52.786883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd203-92f5-4a0f-8a23-779a900ec38b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:52.787154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd203-92f5-4a0f-8a23-779a900ec38b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:52.788273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dd203-92f5-4a0f-8a23-779a900ec38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:52.789721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dd203-92f5-4a0f-8a23-779a900ec38b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:52.791277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:52.797356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164e75b-3140-4c68-ab8a-51b8f1366a97 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:52.837506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:52.892229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164e75b-3140-4c68-ab8a-51b8f1366a97 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:52.925569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec000-56ce-4f04-9a8c-a937a6527d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:52.926111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec000-56ce-4f04-9a8c-a937a6527d68 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:52.926387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec000-56ce-4f04-9a8c-a937a6527d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:52.926657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec000-56ce-4f04-9a8c-a937a6527d68 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:52.927292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ec000-56ce-4f04-9a8c-a937a6527d68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:52.928755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ec000-56ce-4f04-9a8c-a937a6527d68 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:52.954821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:08:52 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:08:55.919390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf4da6-6c72-469e-a896-f8b652be0f93 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:55.920391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf4da6-6c72-469e-a896-f8b652be0f93 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:55.920884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf4da6-6c72-469e-a896-f8b652be0f93 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:55.922764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:55.927931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c807-abc8-48a9-b3ae-ef7da767b639 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:55.928788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c807-abc8-48a9-b3ae-ef7da767b639 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:55.929261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c807-abc8-48a9-b3ae-ef7da767b639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:55.951535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fc33c807-abc8-48a9-b3ae-ef7da767b639 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:55.953054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fc33c807-abc8-48a9-b3ae-ef7da767b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:56.048787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 31/63] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:08:56.062360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959daddd-83de-4067-9756-3d86e4e0d9cf None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.063086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959daddd-83de-4067-9756-3d86e4e0d9cf None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.063898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959daddd-83de-4067-9756-3d86e4e0d9cf None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.066218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 33/64] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:56.072882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603472c-e091-4b09-a461-92c0a90e8cce None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.073536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603472c-e091-4b09-a461-92c0a90e8cce None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.074029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603472c-e091-4b09-a461-92c0a90e8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.104491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f603472c-e091-4b09-a461-92c0a90e8cce None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:56.105722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f603472c-e091-4b09-a461-92c0a90e8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:56.134581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:56.200880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 32/65] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:56.248720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686191f9-180d-4271-842f-e848bd7099ab None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.249026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686191f9-180d-4271-842f-e848bd7099ab None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.249279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686191f9-180d-4271-842f-e848bd7099ab None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.250965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 34/66] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:56.256051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0f6c-be49-435e-9f9a-f97fb144e89b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.256570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0f6c-be49-435e-9f9a-f97fb144e89b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.257047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0f6c-be49-435e-9f9a-f97fb144e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.284398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b8fd0f6c-be49-435e-9f9a-f97fb144e89b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:56.285962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b8fd0f6c-be49-435e-9f9a-f97fb144e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:56.379574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 33/67] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:56.431196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686191f9-180d-4271-842f-e848bd7099ab None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:56.523009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0f6c-be49-435e-9f9a-f97fb144e89b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:56.532601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:56.556545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686191f9-180d-4271-842f-e848bd7099ab None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:56.601929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e8388-9b8d-413a-bfdd-221743bbe1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:56.602568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8388-9b8d-413a-bfdd-221743bbe1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.602852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8388-9b8d-413a-bfdd-221743bbe1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.603487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8388-9b8d-413a-bfdd-221743bbe1f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.618078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e8388-9b8d-413a-bfdd-221743bbe1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-d16e8388-9b8d-413a-bfdd-221743bbe1f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:08:56.623528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:56.624349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:08:56.625107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:08:56.628280 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:08:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:08:56.630452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd60e6-d3dd-4ea1-9e2c-8cfbd2f592d3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.630941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd60e6-d3dd-4ea1-9e2c-8cfbd2f592d3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.631437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd60e6-d3dd-4ea1-9e2c-8cfbd2f592d3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.633169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 36/69] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:56.634108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd60e6-d3dd-4ea1-9e2c-8cfbd2f592d3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:56.635231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:56.653116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0f6c-be49-435e-9f9a-f97fb144e89b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:56.698151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a9fb6-bcc2-46d8-9d65-ae45f59f078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:56.698796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9fb6-bcc2-46d8-9d65-ae45f59f078e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.699078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9fb6-bcc2-46d8-9d65-ae45f59f078e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.699352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9fb6-bcc2-46d8-9d65-ae45f59f078e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.712315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a9fb6-bcc2-46d8-9d65-ae45f59f078e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5b3a9fb6-bcc2-46d8-9d65-ae45f59f078e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:08:56.717230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:56.718148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:08:56.718942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:08:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:08:56.720644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c686-6454-4a1a-a005-737219326442 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.720931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c686-6454-4a1a-a005-737219326442 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.721293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c686-6454-4a1a-a005-737219326442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.739290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-dbd2c686-6454-4a1a-a005-737219326442 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:56.740526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dbd2c686-6454-4a1a-a005-737219326442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:56.751366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd60e6-d3dd-4ea1-9e2c-8cfbd2f592d3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:56.784894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:56.785454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.785736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.786011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.786675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:56.786975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:56.788427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:56.796835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 37/71] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:08:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:56.798162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:56.800659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:56.810843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 35/72] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:56.811953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6ab7f-9d0b-41f6-8d83-30c55a512d60 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.812239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6ab7f-9d0b-41f6-8d83-30c55a512d60 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.812511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6ab7f-9d0b-41f6-8d83-30c55a512d60 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.814455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 36/73] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:08:56.815014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6ab7f-9d0b-41f6-8d83-30c55a512d60 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:56.901873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:56.909167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80f6f1-49a6-41e0-a935-d564d1b79804 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:56.925562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6ab7f-9d0b-41f6-8d83-30c55a512d60 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:56.944776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:56.945469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.945756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.946031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.957149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:08:56.962282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a907a-94ef-4667-9454-234426bb3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:08:56.962714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:56.963536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:08:56.964297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:08:56.964868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a907a-94ef-4667-9454-234426bb3b62 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.964868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a907a-94ef-4667-9454-234426bb3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.964868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a907a-94ef-4667-9454-234426bb3b62 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.965039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:08:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:08:56.965123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a907a-94ef-4667-9454-234426bb3b62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:56.965192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:56.965265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a907a-94ef-4667-9454-234426bb3b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:56.966186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a907a-94ef-4667-9454-234426bb3b62 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:56.975031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:08:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:56.975901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8750ff-f1c6-4285-80f4-f463fca085c6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:56.976185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8750ff-f1c6-4285-80f4-f463fca085c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:56.976460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8750ff-f1c6-4285-80f4-f463fca085c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:56.999460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-de8750ff-f1c6-4285-80f4-f463fca085c6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:08:57.001254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-de8750ff-f1c6-4285-80f4-f463fca085c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:08:57.036835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.083403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 38/76] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:08:57.083403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8750ff-f1c6-4285-80f4-f463fca085c6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.091888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed53ff-3854-4feb-8a93-38ab390d95c6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.126845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.127595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.127947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.128289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] PATH_INFO: `/v3/users/6fc7d729120c446b975c63cfa06003cb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.129798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=6fc7d729120c446b975c63cfa06003cb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.131336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.132981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:08:56 2022] GET /identity/v3/users/6fc7d729120c446b975c63cfa06003cb => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:57.133738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.152199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.185107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8750ff-f1c6-4285-80f4-f463fca085c6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.223469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.224194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.224477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.224750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.225419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:57.225723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.227216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.239854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:57.239997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabeaa2-8fc3-49a2-b464-fcdbc254b1b1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.240109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.268272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.274429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.275152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.275542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.275881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.289124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.290521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.296650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:57.296650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.350107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda8593-58ec-49c9-9a52-38cf70794c9a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.378374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.384073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.384713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.384994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.385267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.395816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:08:57.401066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:08:57.402143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:08:57.403084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:08:57.403739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e07f6-1f73-419b-84e0-f209993be527 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.403822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:08:57.403822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.441424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.442028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.442303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.442572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.496757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.503267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f4ef-0a96-4b85-8c2d-c59b714895e9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.510514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.512059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.536061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.536681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.536961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.537233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.538350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.539870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.541374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:57.542121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.601504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.611068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 41/82] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:08:57.612005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.647522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce07406-fa78-4eae-ae69-bf040e672322 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.681737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.682335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.682612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.682882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.697376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.709866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3fd32-9a22-4ebd-b36c-3adf21f74879 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.744263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.744891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.745176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.745453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.746568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.748077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.749655 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:57.751007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.752842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.754576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.813058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.862415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee80ab4-351b-4312-b97a-2be82f7c2e87 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:57.862614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 42/84] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:08:57.863469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.898721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:57.900007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:57.900007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:57.900007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:57.900528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:57.900829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:57.902218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:57.910595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 43/85] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:57.911403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:57.930124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:57.968445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff13f9-9782-43cd-8f7f-48a8fe950eb9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.007931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.008541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.008822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.009097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.010104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7a6a-bd0c-4afc-8e8b-b0ab36b88bad None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.036670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:58.044175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.044798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.045077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.045348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.046484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.048532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.050150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 44/86] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:58.050890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.077594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.079189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.138942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:58.154911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37ef0-0fb0-47ce-ae9d-527ba5067575 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.176413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 43/87] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:08:58.180206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.188448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.189922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.190229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.190506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.191161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.192647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.221295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 45/88] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:08:58 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:08:58.222109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.241016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:58.289159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba72ba-b1e8-49f0-99f6-ee0728de6fee None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.329014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.329604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.329891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.330172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.331427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.333174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.334974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 44/89] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:08:58 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:58.335789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.348506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c0c9-8633-450f-b4c9-94ae204747b1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.389597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.390266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.390825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.391662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.393199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.396191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.396932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 46/90] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:08:58 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:58.398221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.411575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:58.456886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaff26f-5b13-4098-9238-223272aeff5c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.491569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:58.502202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.502845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.503125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.503965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.504767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=6fc7d729120c446b975c63cfa06003cb) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:58.505191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.506992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.513732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:08:58 2022] GET /identity/v3/role_assignments?user.id=6fc7d729120c446b975c63cfa06003cb&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:58.514547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.524291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1ffe-f89b-4c93-8ad9-41d58cb19591 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.570866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.571549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.571833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.572108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.581214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.583014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.585509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 47/92] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:08:58 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:58.586155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.661119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5362c-b5f0-49f2-93dc-375587dc5c4b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.695444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:58.722300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.723179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.723486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.723763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.724500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=a740d61e1d9f4107897b20c8ed8d9140) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:58.724692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816dc86-e9c7-456f-ac6c-c3797d3bdbc4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.724791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.726617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.736861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:08:58 2022] GET /identity/v3/role_assignments?user.id=a740d61e1d9f4107897b20c8ed8d9140&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:58.738102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:58.809665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:58.832323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.833331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.833837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.834319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.865704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71f655-e0b8-4044-bc63-dbcb503b47d7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:58.908666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:58.909281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:58.909560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:58.909953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:58.910947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] RBAC: Adding query filter params (role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=a740d61e1d9f4107897b20c8ed8d9140) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:58.911255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.913302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:58.919815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:08:58 2022] GET /identity/v3/role_assignments?user.id=a740d61e1d9f4107897b20c8ed8d9140&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:58.995590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:58.997439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:59.083884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:59.110337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 48/95] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:08:59.117692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:59.270735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650c6c2-217f-4ad3-9e84-b831dd5b8db7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:59.295953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:08:59.315174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d963758-cc12-47f9-b414-7492613bdf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:59.316165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963758-cc12-47f9-b414-7492613bdf56 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:59.316642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963758-cc12-47f9-b414-7492613bdf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:59.317122 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963758-cc12-47f9-b414-7492613bdf56 None admin] PATH_INFO: `/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:59.318464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963758-cc12-47f9-b414-7492613bdf56 None admin] RBAC: Authorizing `identity:get_project(project_id=3d48fabd7c22486bb5ebb4bb6d4c0ffb)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:59.320158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963758-cc12-47f9-b414-7492613bdf56 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:59.322015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:08:59 2022] GET /identity/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:08:59.328174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:08:59.469384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580841-0cdf-42cc-927c-55a0a160c783 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:08:59.514292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292972d-74ca-4de5-a216-90f12a3e0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:08:59.514906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292972d-74ca-4de5-a216-90f12a3e0cec None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:08:59.515188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292972d-74ca-4de5-a216-90f12a3e0cec None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:08:59.515489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292972d-74ca-4de5-a216-90f12a3e0cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:08:59.516792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292972d-74ca-4de5-a216-90f12a3e0cec None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=3d48fabd7c22486bb5ebb4bb6d4c0ffb, user.id=a740d61e1d9f4107897b20c8ed8d9140) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:08:59.517106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292972d-74ca-4de5-a216-90f12a3e0cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:08:59.518632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292972d-74ca-4de5-a216-90f12a3e0cec None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:08:59.527671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:08:59 2022] GET /identity/v3/role_assignments?user.id=a740d61e1d9f4107897b20c8ed8d9140&scope.project.id=3d48fabd7c22486bb5ebb4bb6d4c0ffb&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:00.708768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4812-4971-4c43-859b-09e5ad44c1c1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:00.709775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4812-4971-4c43-859b-09e5ad44c1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:00.710371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4812-4971-4c43-859b-09e5ad44c1c1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:00.711955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:00.717177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47c20e-d6c2-419c-9f23-65ccc9a93db6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:00.717968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47c20e-d6c2-419c-9f23-65ccc9a93db6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:00.718440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47c20e-d6c2-419c-9f23-65ccc9a93db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:00.740537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5b47c20e-d6c2-419c-9f23-65ccc9a93db6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:00.742082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5b47c20e-d6c2-419c-9f23-65ccc9a93db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:00.790546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:00.836708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 50/99] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:01.268586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ca01c-8c48-4364-93f3-6e82c0f7f335 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.269252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ca01c-8c48-4364-93f3-6e82c0f7f335 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.269736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ca01c-8c48-4364-93f3-6e82c0f7f335 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.271281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 50/100] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:01.276446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c84b-0730-4e82-9153-0350961e1c47 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.276731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c84b-0730-4e82-9153-0350961e1c47 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.277002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c84b-0730-4e82-9153-0350961e1c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.301983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8ea1c84b-0730-4e82-9153-0350961e1c47 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:01.303166 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8ea1c84b-0730-4e82-9153-0350961e1c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:01.395944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 51/101] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:01.400890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ca01c-8c48-4364-93f3-6e82c0f7f335 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:01.566976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ca01c-8c48-4364-93f3-6e82c0f7f335 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:01.610902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:01.611590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.611870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.612142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.618963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476395de-29e3-48c4-bfa3-5fd385c8703f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.619256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476395de-29e3-48c4-bfa3-5fd385c8703f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.619577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476395de-29e3-48c4-bfa3-5fd385c8703f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.620970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 52/102] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:01.626055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f762433-4d8f-4a40-a901-f766cba38395 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.626346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f762433-4d8f-4a40-a901-f766cba38395 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.626630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f762433-4d8f-4a40-a901-f766cba38395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.632261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:01.638447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:01.639417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:01.640174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 51/103] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:01.646816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:01.659809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2f762433-4d8f-4a40-a901-f766cba38395 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:01.662011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2f762433-4d8f-4a40-a901-f766cba38395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:01.767736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:01.798339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 53/104] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:01.842351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84ae3-069e-4c6c-8a52-5d9f793659c9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:01.867295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecd59d-0787-43c3-9c54-182812550f09 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.867609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecd59d-0787-43c3-9c54-182812550f09 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.867890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecd59d-0787-43c3-9c54-182812550f09 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.869250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 54/105] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:01.884688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f929-69ba-4e46-a7c2-4596c7e27647 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.884973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f929-69ba-4e46-a7c2-4596c7e27647 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.885252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f929-69ba-4e46-a7c2-4596c7e27647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.899886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:01.900556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:01.900837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:01.901109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:01.901833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:01.902183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:01.903642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:01.914850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 52/106] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:01.917316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-90d7f929-69ba-4e46-a7c2-4596c7e27647 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:01.918546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-90d7f929-69ba-4e46-a7c2-4596c7e27647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:01.921480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:01.956236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:01.998772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 55/107] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:02.004150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f929-69ba-4e46-a7c2-4596c7e27647 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.088587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab672716-8993-4403-883b-bdcd9608f7ad None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.109153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f929-69ba-4e46-a7c2-4596c7e27647 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.123805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:02.161445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.162085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.162369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.162651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] PATH_INFO: `/v3/users/5f9cfa189ce84c178ca0fa78973cfefe` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.168098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.168740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.169020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.169296 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.175347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:02.176856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:02.178468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 56/108] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:02.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.197943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] RBAC: Authorizing `identity:get_user(user_id=5f9cfa189ce84c178ca0fa78973cfefe)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:02.199471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:02.201185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 53/109] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:01 2022] GET /identity/v3/users/5f9cfa189ce84c178ca0fa78973cfefe => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:02.207356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.239785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:02.325793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8290-40e0-45a9-99a6-d4b5b035e560 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.343231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38f6f-c373-465f-ad3d-4319aa5261e6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.359036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac290bd1-2d49-4cbb-8699-d2075e59006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.359723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290bd1-2d49-4cbb-8699-d2075e59006d None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.360030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290bd1-2d49-4cbb-8699-d2075e59006d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.360243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290bd1-2d49-4cbb-8699-d2075e59006d None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.360886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac290bd1-2d49-4cbb-8699-d2075e59006d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:02.362341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac290bd1-2d49-4cbb-8699-d2075e59006d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:02.376926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce2539-6de2-4f71-bf24-a29c43e5801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.377526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce2539-6de2-4f71-bf24-a29c43e5801b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.377802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce2539-6de2-4f71-bf24-a29c43e5801b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.378069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce2539-6de2-4f71-bf24-a29c43e5801b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.387906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 57/110] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:09:02 2022] POST /identity/v3/projects => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:09:02.389120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea7155-4ede-4b37-83c8-4f0b42e9c7d9 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.389401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea7155-4ede-4b37-83c8-4f0b42e9c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.389676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea7155-4ede-4b37-83c8-4f0b42e9c7d9 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.391081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 58/111] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:02.392225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea7155-4ede-4b37-83c8-4f0b42e9c7d9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.421596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:02.464312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce2539-6de2-4f71-bf24-a29c43e5801b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:02.465964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce2539-6de2-4f71-bf24-a29c43e5801b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:02.487900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:02.512164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea7155-4ede-4b37-83c8-4f0b42e9c7d9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.556520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.557453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.557738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.558013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.570236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:02.575227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:02.576083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:02.576817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 59/112] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:02.577924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.578016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 54/113] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:09:02.579850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c837f-91b2-4e07-bbed-4736137a4c5b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.580139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c837f-91b2-4e07-bbed-4736137a4c5b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.580415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c837f-91b2-4e07-bbed-4736137a4c5b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.581679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 55/114] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:02.582708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9d4e-fd53-476a-8e4f-18a8c4685d96 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.582986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9d4e-fd53-476a-8e4f-18a8c4685d96 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.583417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9d4e-fd53-476a-8e4f-18a8c4685d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.602342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4e7a9d4e-fd53-476a-8e4f-18a8c4685d96 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:02.603587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4e7a9d4e-fd53-476a-8e4f-18a8c4685d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:02.668955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:02.675166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 56/115] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:02.675864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9d4e-fd53-476a-8e4f-18a8c4685d96 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.710205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d4e0-0b39-4803-a044-987d741d86d8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.755791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.756665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.757349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.757768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.772174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:02.778923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:02.779976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:02.780933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:02.783662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 60/116] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:02.788308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.793925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:02.801371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9d4e-fd53-476a-8e4f-18a8c4685d96 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.839969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb988b92-c4d0-4933-bfaf-d4f6089e6e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.840576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988b92-c4d0-4933-bfaf-d4f6089e6e46 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.840855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988b92-c4d0-4933-bfaf-d4f6089e6e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.841126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988b92-c4d0-4933-bfaf-d4f6089e6e46 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.841791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb988b92-c4d0-4933-bfaf-d4f6089e6e46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:02.842091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb988b92-c4d0-4933-bfaf-d4f6089e6e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:02.843501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb988b92-c4d0-4933-bfaf-d4f6089e6e46 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:02.852652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 57/117] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:02.854046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c318bd-10e7-4fc1-9355-ad2b40966fe7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.854335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c318bd-10e7-4fc1-9355-ad2b40966fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.854718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c318bd-10e7-4fc1-9355-ad2b40966fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.875109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-40c318bd-10e7-4fc1-9355-ad2b40966fe7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:02.876898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-40c318bd-10e7-4fc1-9355-ad2b40966fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:02.928587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f1563-9b1b-4211-9e6b-923676d12b8b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:02.935420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:02.950900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 58/118] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:02.951794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c318bd-10e7-4fc1-9355-ad2b40966fe7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:02.980951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:02.987533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:02.987851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:02.990053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:02.992096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:02.995926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:02.995926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 61/119] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:02 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:02.999805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.068083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c318bd-10e7-4fc1-9355-ad2b40966fe7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.095290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:03.108614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.109220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.109499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.109764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.110452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:03.110751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.112316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.120607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 59/120] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:03.125224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.146175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e340e29-3946-4475-a920-36a8f94d56cd None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.180922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:03.196170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.197622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.198400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.198877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] PATH_INFO: `/v3/users/6fc7d729120c446b975c63cfa06003cb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.201331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] RBAC: Authorizing `identity:get_user(user_id=6fc7d729120c446b975c63cfa06003cb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.203009 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.205402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 62/121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:02 2022] GET /identity/v3/users/6fc7d729120c446b975c63cfa06003cb => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:03.206919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.233615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050fb38-c79b-4c23-b27f-b456dd86cf80 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.270628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.271550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.272015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.272560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.284488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:03.289956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:03.290927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:03.291958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:03.293977 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:03.294934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.318980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264a81f-41ba-485a-8db8-768e9c00fdbe None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.352908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.353706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.354211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.354631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.355545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] RBAC: Adding query filter params (role.id=c020279e20bc478088b9dee61b83fee6, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=5f9cfa189ce84c178ca0fa78973cfefe) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:03.355861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.357371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.371404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/role_assignments?user.id=5f9cfa189ce84c178ca0fa78973cfefe&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=c020279e20bc478088b9dee61b83fee6 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:03.371404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.374828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:03.427592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6926-f857-48d8-9916-f996d0624b5d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.443671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:03.468008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.468758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.469117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.469524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.470973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.472571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.479085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:03.480024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.521265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f035e2-12b8-4298-9c4c-1b7956ce4d41 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.566351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.567134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.567543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.567913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.569153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.571317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.573811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 64/125] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:03.574894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.596893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5af4e-a458-4aa6-aadd-267b60aecc0d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.634362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.635002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.635287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.635614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.648646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:03.656176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:03.657089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:03.657860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 62/126] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:03.658495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.696607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:03.716198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1f89-fadb-41e2-876b-9f74545e810b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.717413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:03.762757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.763367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.763668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.764344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.764653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:03.765007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.766736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.774971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 65/127] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:03.779970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.795097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71fb77-aeb4-4abe-b400-d1e727c1eee2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.839776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.841314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.841741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.842317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.844252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.846874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.848955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 63/128] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:03.849863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.895809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961312-1d5e-47ef-82f9-b1d6c5ec9ad0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.927404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:03.932690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:03.934095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:03.934576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:03.935047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/6fc7d729120c446b975c63cfa06003cb/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:03.937348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] RBAC: Authorizing `identity:create_grant(project_id=020e792f68e2488e84a2d16ea12d0c27, user_id=6fc7d729120c446b975c63cfa06003cb, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:03.939139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:03.956292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 66/129] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:03 2022] PUT /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/6fc7d729120c446b975c63cfa06003cb/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:03.957467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:03.970125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83372f2-afda-46dc-a6f3-776168d00900 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:03.981678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:04.013879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.015002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.015574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.016093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.016960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:04.017509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.019429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.029819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 64/130] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:04.030902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:04.103669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d500d-c53d-4c44-aa05-6347f44f351f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:04.146767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.147588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.147971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.148347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.149599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.151167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.152971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 67/131] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:03 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:04.153943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:04.204517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff919f-9dda-4c81-ac91-955f7641ce1d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:04.222737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:04.240015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.240948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.241375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.241811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/a740d61e1d9f4107897b20c8ed8d9140/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.252159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=020e792f68e2488e84a2d16ea12d0c27, user_id=a740d61e1d9f4107897b20c8ed8d9140, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.253809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.270470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb87c2d-2afd-4ca7-9e40-4d6f403c3fd5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:04.285652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 65/132] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:04 2022] PUT /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/a740d61e1d9f4107897b20c8ed8d9140/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:04.286496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:04.314419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.315312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.315971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.316998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.319562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.321828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.324791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 68/133] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:04 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:04.331045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:04.355413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:04.519606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b5bfb-f979-4b44-b136-7a507cf15aec None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:04.523701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5dea3-e1e2-4a43-9992-ff193c589a56 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:04.548382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:04.557042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded51c72-55b7-44d9-8f90-38433c5b5611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.557837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51c72-55b7-44d9-8f90-38433c5b5611 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.558225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51c72-55b7-44d9-8f90-38433c5b5611 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.558610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51c72-55b7-44d9-8f90-38433c5b5611 None admin] PATH_INFO: `/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.560017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded51c72-55b7-44d9-8f90-38433c5b5611 None admin] RBAC: Authorizing `identity:get_project(project_id=3d48fabd7c22486bb5ebb4bb6d4c0ffb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.561866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded51c72-55b7-44d9-8f90-38433c5b5611 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.564683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 69/134] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:04 2022] GET /identity/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:04.566088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bf59-137d-4b6b-b2b9-f9a4e3f42625 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.566471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bf59-137d-4b6b-b2b9-f9a4e3f42625 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.566846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bf59-137d-4b6b-b2b9-f9a4e3f42625 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.568259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 70/135] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:04.572305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262bf59-137d-4b6b-b2b9-f9a4e3f42625 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:04.595339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3956e-4ad8-4fe1-85a1-3df187cf4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.596034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3956e-4ad8-4fe1-85a1-3df187cf4587 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.596311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3956e-4ad8-4fe1-85a1-3df187cf4587 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.596718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3956e-4ad8-4fe1-85a1-3df187cf4587 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.597874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3956e-4ad8-4fe1-85a1-3df187cf4587 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.599336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3956e-4ad8-4fe1-85a1-3df187cf4587 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.600982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 66/136] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:04 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:04.602077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eed6b5-578c-433a-9272-75bf2d690d4e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.602343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eed6b5-578c-433a-9272-75bf2d690d4e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.602611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eed6b5-578c-433a-9272-75bf2d690d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.625317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e9eed6b5-578c-433a-9272-75bf2d690d4e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:04.627265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e9eed6b5-578c-433a-9272-75bf2d690d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:04.682381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262bf59-137d-4b6b-b2b9-f9a4e3f42625 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:04.713098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 67/137] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:04.714271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eed6b5-578c-433a-9272-75bf2d690d4e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:04.729546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.730411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.730791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.731170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] PATH_INFO: `/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb/users/a740d61e1d9f4107897b20c8ed8d9140/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.736902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d48fabd7c22486bb5ebb4bb6d4c0ffb, user_id=a740d61e1d9f4107897b20c8ed8d9140, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.738550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.747137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:04.785634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 71/138] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:04 2022] PUT /identity/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb/users/a740d61e1d9f4107897b20c8ed8d9140/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:04.849343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eed6b5-578c-433a-9272-75bf2d690d4e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:04.886843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:04.887839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:04.888264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:04.888682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/a740d61e1d9f4107897b20c8ed8d9140/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:04.891087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] RBAC: Authorizing `identity:create_grant(project_id=020e792f68e2488e84a2d16ea12d0c27, user_id=a740d61e1d9f4107897b20c8ed8d9140, role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:04.893327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:04.917157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 68/139] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:04 2022] PUT /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/a740d61e1d9f4107897b20c8ed8d9140/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:05.122815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:05.194718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:05.257194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc834d-e399-4144-bb66-41a903cbbcc1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:05.316775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097b8d6-29e8-4ad9-a36c-106fbc97132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:05.317845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097b8d6-29e8-4ad9-a36c-106fbc97132f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:05.318310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097b8d6-29e8-4ad9-a36c-106fbc97132f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:05.318802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097b8d6-29e8-4ad9-a36c-106fbc97132f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:05.320669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097b8d6-29e8-4ad9-a36c-106fbc97132f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:05.323422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097b8d6-29e8-4ad9-a36c-106fbc97132f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:05.326371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 72/140] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:05.332879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:05.460136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:05.469342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6464d-343a-4a9b-91a7-ecc7861ec337 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:05.506586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb17f7-c18b-4067-b6b7-1e098b23a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:05.507605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb17f7-c18b-4067-b6b7-1e098b23a64b None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:05.508089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb17f7-c18b-4067-b6b7-1e098b23a64b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:05.508760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb17f7-c18b-4067-b6b7-1e098b23a64b None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:05.509672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb17f7-c18b-4067-b6b7-1e098b23a64b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:05.511329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb17f7-c18b-4067-b6b7-1e098b23a64b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:05.541435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 69/141] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:05 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:09:06.307757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c1c7-1d6b-4986-b604-f4c75b785fea None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:06.308399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c1c7-1d6b-4986-b604-f4c75b785fea None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:06.308937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c1c7-1d6b-4986-b604-f4c75b785fea None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:06.311672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 73/142] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:06.323135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df489f85-6a4a-4141-88d0-1d2c39bda5ea None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:06.323670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df489f85-6a4a-4141-88d0-1d2c39bda5ea None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:06.324168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df489f85-6a4a-4141-88d0-1d2c39bda5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:06.355084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-df489f85-6a4a-4141-88d0-1d2c39bda5ea None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:06.357136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-df489f85-6a4a-4141-88d0-1d2c39bda5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:06.495981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 70/143] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:06.644237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f734e2-be74-41d0-aa34-22223b8b4a9f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:06.644647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f734e2-be74-41d0-aa34-22223b8b4a9f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:06.645116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f734e2-be74-41d0-aa34-22223b8b4a9f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:06.647737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 74/144] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:06.654246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f33e-7c2a-4dff-b737-405ee9e6251c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:06.654754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f33e-7c2a-4dff-b737-405ee9e6251c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:06.655249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f33e-7c2a-4dff-b737-405ee9e6251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:06.692685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a830f33e-7c2a-4dff-b737-405ee9e6251c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:06.694694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a830f33e-7c2a-4dff-b737-405ee9e6251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:06.821682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 71/145] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:07.027673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f734e2-be74-41d0-aa34-22223b8b4a9f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.199774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f734e2-be74-41d0-aa34-22223b8b4a9f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.236370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:07.254047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.254885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.255163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.255457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:07.270390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:07.275294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:07.276145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:07.276973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 75/146] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:07.284080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f33e-7c2a-4dff-b737-405ee9e6251c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.287752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:07.301603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.404844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f33e-7c2a-4dff-b737-405ee9e6251c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.416920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86fe4c-d975-4574-97cb-f18027a0e30e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.446764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.447750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.448197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.448747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:07.449614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:07.450113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:07.451951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:07.457767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.458718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.459140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.459578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:07.462049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 72/147] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:07.467582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.472660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:07.479723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:07.480702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:07.481691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:07.484264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 76/148] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:07.490385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.545123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:07.548893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:07.589151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00b171-bc8f-4a57-aebe-fa74febef97a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.607902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617fd89-df5e-475b-8957-a169e82fe892 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.625583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.626920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.627429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.627815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] PATH_INFO: `/v3/users/5f9cfa189ce84c178ca0fa78973cfefe` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:07.629144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] RBAC: Authorizing `identity:get_user(user_id=5f9cfa189ce84c178ca0fa78973cfefe)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:07.630976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:07.632988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 73/149] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/users/5f9cfa189ce84c178ca0fa78973cfefe => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:07.638472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.651046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.651911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.652435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.652926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:07.653904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:07.654488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:07.656126 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:07.666031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 77/150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:07.671834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.780197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed9ee6-8739-43fd-9401-6b859c3c4945 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.784169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bf79-3470-4f88-bcfd-3cca2d4e76bc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.791931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:07.830199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.830750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.831026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.831300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] PATH_INFO: `/v3/users/6fc7d729120c446b975c63cfa06003cb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:07.832694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] RBAC: Authorizing `identity:get_user(user_id=6fc7d729120c446b975c63cfa06003cb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:07.834151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:07.835999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 78/151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/users/6fc7d729120c446b975c63cfa06003cb => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:07.841455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.845887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.846807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.847298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.847815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:07.849200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:07.851033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:07.853258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 74/152] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:07.859502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:07.864613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:07.953302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7602-2ac2-4ea4-be6e-70c0f99ec538 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:07.990960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:07.991871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:07.992402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:07.992824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.009469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748a46-64d0-470d-8996-8095f9ca7a49 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:08.044052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:08.049895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d77c4-620a-4e7a-9291-387e19180e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:08.051048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d77c4-620a-4e7a-9291-387e19180e59 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:08.051572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d77c4-620a-4e7a-9291-387e19180e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:08.052113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d77c4-620a-4e7a-9291-387e19180e59 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/5f9cfa189ce84c178ca0fa78973cfefe/roles/c020279e20bc478088b9dee61b83fee6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.054315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d77c4-620a-4e7a-9291-387e19180e59 None admin] RBAC: Authorizing `identity:create_grant(project_id=020e792f68e2488e84a2d16ea12d0c27, user_id=5f9cfa189ce84c178ca0fa78973cfefe, role_id=c020279e20bc478088b9dee61b83fee6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:08.056270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d77c4-620a-4e7a-9291-387e19180e59 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:08.072426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:08.073930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:08.074589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 75/153] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:07 2022] PUT /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27/users/5f9cfa189ce84c178ca0fa78973cfefe/roles/c020279e20bc478088b9dee61b83fee6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:09:08.076481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1cf64-bd31-4bd5-9e0c-3e116388f87f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:08.078052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1cf64-bd31-4bd5-9e0c-3e116388f87f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:08.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1cf64-bd31-4bd5-9e0c-3e116388f87f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.080560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 76/154] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:08.088483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ebca-ba80-4ae9-87e1-387675963861 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:08.089382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ebca-ba80-4ae9-87e1-387675963861 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:08.089875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ebca-ba80-4ae9-87e1-387675963861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.124892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7345ebca-ba80-4ae9-87e1-387675963861 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:08.126765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7345ebca-ba80-4ae9-87e1-387675963861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:08.262886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:08.264097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 79/155] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:09:08.269828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:08.289087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 77/156] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:08.390221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:08.418734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95439fbc-c94c-439f-829e-ebdbd40cc132 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:08.467625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17f422-d391-4a5e-9204-3ecc7af56cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:08.468272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17f422-d391-4a5e-9204-3ecc7af56cdb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:08.468554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17f422-d391-4a5e-9204-3ecc7af56cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:08.468827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17f422-d391-4a5e-9204-3ecc7af56cdb None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.470563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17f422-d391-4a5e-9204-3ecc7af56cdb None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:08.472052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17f422-d391-4a5e-9204-3ecc7af56cdb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:08.473697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 80/157] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:08 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:08.479630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ebca-ba80-4ae9-87e1-387675963861 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:08.590074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ebca-ba80-4ae9-87e1-387675963861 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:08.626165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934124-0f5e-4f8c-86cd-5dc636b38f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:08.626781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934124-0f5e-4f8c-86cd-5dc636b38f1f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:08.627065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934124-0f5e-4f8c-86cd-5dc636b38f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:08.627332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934124-0f5e-4f8c-86cd-5dc636b38f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.628100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934124-0f5e-4f8c-86cd-5dc636b38f1f None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=6fc7d729120c446b975c63cfa06003cb) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:08.628407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934124-0f5e-4f8c-86cd-5dc636b38f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:08.630125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934124-0f5e-4f8c-86cd-5dc636b38f1f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:08.636288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 78/158] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:08 2022] GET /identity/v3/role_assignments?user.id=6fc7d729120c446b975c63cfa06003cb&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:08.703087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc60b-52af-4543-a582-8d1e9bb3d1a7 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:08.703428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc60b-52af-4543-a582-8d1e9bb3d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:08.703670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc60b-52af-4543-a582-8d1e9bb3d1a7 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.705767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 81/159] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:08.711133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67aa24-3ac5-4459-84b2-86d13c70b6cb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:08.711484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67aa24-3ac5-4459-84b2-86d13c70b6cb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:08.711789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67aa24-3ac5-4459-84b2-86d13c70b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:08.740509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4a67aa24-3ac5-4459-84b2-86d13c70b6cb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:08.741736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4a67aa24-3ac5-4459-84b2-86d13c70b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:08.803690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:08.823428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 79/160] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:08.944973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cc60b-52af-4543-a582-8d1e9bb3d1a7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:09.087315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cc60b-52af-4543-a582-8d1e9bb3d1a7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:09.127877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:09.128509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:09.128787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:09.129056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:09.148892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:09.153911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:09.155654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:09.156950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 82/161] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:09.162057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67aa24-3ac5-4459-84b2-86d13c70b6cb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:09.173146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:09.181550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:09.355329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67aa24-3ac5-4459-84b2-86d13c70b6cb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:09.403163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a0927-f86c-4030-99a3-4f6e76a86220 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:09.432149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:09.432811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:09.433078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:09.433369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:09.434055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:09.434346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:09.435858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:09.448098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 80/162] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:09.453762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:09.474191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813409-9d4a-4386-9e78-350880466abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:09.474866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813409-9d4a-4386-9e78-350880466abb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:09.475147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813409-9d4a-4386-9e78-350880466abb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:09.475393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813409-9d4a-4386-9e78-350880466abb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:09.501388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813409-9d4a-4386-9e78-350880466abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-21813409-9d4a-4386-9e78-350880466abb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:09.508840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:09.509713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:09.510478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 83/163] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:09.512316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0c696-7fd5-40b0-9fb7-ad023b9fa8c4 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:09.512316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0c696-7fd5-40b0-9fb7-ad023b9fa8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:09.512316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0c696-7fd5-40b0-9fb7-ad023b9fa8c4 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:09.513786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 84/164] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:09.524224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0c696-7fd5-40b0-9fb7-ad023b9fa8c4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:09.553493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:09.647168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3305e5-3ae8-43ff-bc33-ff13ea0ff44b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:09.657089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:09.711778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c481b-a2ad-4677-97a3-fa3c4be98305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:09.712407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c481b-a2ad-4677-97a3-fa3c4be98305 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:09.712680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c481b-a2ad-4677-97a3-fa3c4be98305 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:09.712945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c481b-a2ad-4677-97a3-fa3c4be98305 None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:09.714183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c481b-a2ad-4677-97a3-fa3c4be98305 None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:09.715660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c481b-a2ad-4677-97a3-fa3c4be98305 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:09.717226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 81/165] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:09 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:09.718308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec075f8-4533-49fd-b0cc-fe68246335aa None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:09.718581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec075f8-4533-49fd-b0cc-fe68246335aa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:09.718849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec075f8-4533-49fd-b0cc-fe68246335aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:09.727045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0c696-7fd5-40b0-9fb7-ad023b9fa8c4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:09.766285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-aec075f8-4533-49fd-b0cc-fe68246335aa None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:09.767531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aec075f8-4533-49fd-b0cc-fe68246335aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:09.805595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:09.806202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:09.806473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:09.806740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:09.808635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:09.808940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:09.811144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:09.833709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 85/166] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:09.834591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:09.935980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 82/167] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:09.936763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec075f8-4533-49fd-b0cc-fe68246335aa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:10.044990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:10.059594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9fe3-34bd-4f00-92ba-143a24f366e9 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:10.099439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:10.114822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:10.115743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.119734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.120010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.128590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec075f8-4533-49fd-b0cc-fe68246335aa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:10.164030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:10.164666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.164944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.165215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.166347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:10.167849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:10.169434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 83/168] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:09 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:10.174993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:10.238200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:10.239791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:10.278606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69df55-2bed-444d-b97d-c03f84bb21ed None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:10.297502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:10.315365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:10.316161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.316552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.316971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.357377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 86/169] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:10.362994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:10.390337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:10.474736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cef12-f806-4979-93ad-edc7a4f44332 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:10.476292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:10.477883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:10.515203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:10.516016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.516368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.517180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.518548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:10.524594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:10.526566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 87/170] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:10 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:10.533443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:10.651763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:10.655331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777e71e-a9f7-4370-b0d5-d236287ba27a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:10.696508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 84/171] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:10.697396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:10.721153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7028b-8e9f-4cb9-95b6-e24edbd3e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:10.721761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7028b-8e9f-4cb9-95b6-e24edbd3e56a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.722033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7028b-8e9f-4cb9-95b6-e24edbd3e56a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.722301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7028b-8e9f-4cb9-95b6-e24edbd3e56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.723019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7028b-8e9f-4cb9-95b6-e24edbd3e56a None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=a740d61e1d9f4107897b20c8ed8d9140) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:10.723319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7028b-8e9f-4cb9-95b6-e24edbd3e56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:10.724780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7028b-8e9f-4cb9-95b6-e24edbd3e56a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:10.729587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:10.737918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 88/172] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:10 2022] GET /identity/v3/role_assignments?user.id=a740d61e1d9f4107897b20c8ed8d9140&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:10.739127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e326-504e-4738-9a95-3c6355184fae None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.742359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e326-504e-4738-9a95-3c6355184fae None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.742686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e326-504e-4738-9a95-3c6355184fae None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.744375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 89/173] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:10.745138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67e326-504e-4738-9a95-3c6355184fae None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:10.838372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3412-bf67-4fcc-ab0d-48934450b190 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:10.881537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12232d0b-1283-4986-904a-16a6e0222490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:10.882232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12232d0b-1283-4986-904a-16a6e0222490 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.882513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12232d0b-1283-4986-904a-16a6e0222490 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.882786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12232d0b-1283-4986-904a-16a6e0222490 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.903956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12232d0b-1283-4986-904a-16a6e0222490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-12232d0b-1283-4986-904a-16a6e0222490 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:10.909067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:10.910004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 85/174] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:10.915919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb0d2-4176-4e6e-a45a-ac012a891403 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:10.916651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb0d2-4176-4e6e-a45a-ac012a891403 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:10.916651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb0d2-4176-4e6e-a45a-ac012a891403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:10.949179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-73dbb0d2-4176-4e6e-a45a-ac012a891403 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:10.950398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-73dbb0d2-4176-4e6e-a45a-ac012a891403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:10.997256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67e326-504e-4738-9a95-3c6355184fae None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.022137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 86/175] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:11.023087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbb0d2-4176-4e6e-a45a-ac012a891403 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:11.026828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:11.077086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2295d-be43-4058-93f7-f48330294f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.077745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2295d-be43-4058-93f7-f48330294f7e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.078022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2295d-be43-4058-93f7-f48330294f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.078293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2295d-be43-4058-93f7-f48330294f7e None admin] PATH_INFO: `/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.079522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2295d-be43-4058-93f7-f48330294f7e None admin] RBAC: Authorizing `identity:get_project(project_id=3d48fabd7c22486bb5ebb4bb6d4c0ffb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:11.080993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2295d-be43-4058-93f7-f48330294f7e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:11.082648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 90/176] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:10 2022] GET /identity/v3/projects/3d48fabd7c22486bb5ebb4bb6d4c0ffb => generated 312 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:11.089792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d20ac-dde3-4d25-b473-28173633ba9c None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.090019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d20ac-dde3-4d25-b473-28173633ba9c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.090271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d20ac-dde3-4d25-b473-28173633ba9c None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.092952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 91/177] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:11.097345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65598df-8c09-4e3c-b442-1e109076ed89 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.097856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65598df-8c09-4e3c-b442-1e109076ed89 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.098330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65598df-8c09-4e3c-b442-1e109076ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.119526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d65598df-8c09-4e3c-b442-1e109076ed89 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:11.120725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d65598df-8c09-4e3c-b442-1e109076ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:11.136786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbb0d2-4176-4e6e-a45a-ac012a891403 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.143714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:11.173377 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.174069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.174346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.174617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.175339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:11.175668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:11.177046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:11.185796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 87/178] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:11.186661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:11.242548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 92/179] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:11.243899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65598df-8c09-4e3c-b442-1e109076ed89 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:11.264532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:11.315845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42956e-696d-4842-bf05-06cb53d8dcb3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.376633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282414c-d709-42c8-894e-23ad37f8739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.377166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282414c-d709-42c8-894e-23ad37f8739f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.377441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282414c-d709-42c8-894e-23ad37f8739f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.377707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282414c-d709-42c8-894e-23ad37f8739f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.378447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282414c-d709-42c8-894e-23ad37f8739f None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=3d48fabd7c22486bb5ebb4bb6d4c0ffb, user.id=a740d61e1d9f4107897b20c8ed8d9140) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:11.378752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282414c-d709-42c8-894e-23ad37f8739f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:11.381467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282414c-d709-42c8-894e-23ad37f8739f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:11.395629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 88/180] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:11 2022] GET /identity/v3/role_assignments?user.id=a740d61e1d9f4107897b20c8ed8d9140&scope.project.id=3d48fabd7c22486bb5ebb4bb6d4c0ffb&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:11.396916 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5de4-dbce-4c48-9419-939d198275ba None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.397206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5de4-dbce-4c48-9419-939d198275ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.397476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5de4-dbce-4c48-9419-939d198275ba None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.408024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 89/181] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:11.408986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a5de4-dbce-4c48-9419-939d198275ba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:11.420616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65598df-8c09-4e3c-b442-1e109076ed89 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.464030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c1264-a8d9-4d8f-924e-fc3684253154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.465424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c1264-a8d9-4d8f-924e-fc3684253154 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.465910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c1264-a8d9-4d8f-924e-fc3684253154 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.466693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c1264-a8d9-4d8f-924e-fc3684253154 None admin] PATH_INFO: `/v3/users/a740d61e1d9f4107897b20c8ed8d9140` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.468720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c1264-a8d9-4d8f-924e-fc3684253154 None admin] RBAC: Authorizing `identity:get_user(user_id=a740d61e1d9f4107897b20c8ed8d9140)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:11.471023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c1264-a8d9-4d8f-924e-fc3684253154 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:11.473352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 93/182] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:11 2022] GET /identity/v3/users/a740d61e1d9f4107897b20c8ed8d9140 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:11.475135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71972-9578-4df6-afa4-4f339436e25e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.476634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71972-9578-4df6-afa4-4f339436e25e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.477126 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71972-9578-4df6-afa4-4f339436e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.501449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-07d71972-9578-4df6-afa4-4f339436e25e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:11.503329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-07d71972-9578-4df6-afa4-4f339436e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:11.528835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:11.575782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a5de4-dbce-4c48-9419-939d198275ba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.603158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 94/183] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:11.604489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d71972-9578-4df6-afa4-4f339436e25e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:11.620881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:11.629822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b53464-d8d2-480c-9b02-720ee4c4c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.630707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53464-d8d2-480c-9b02-720ee4c4c94d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.631157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53464-d8d2-480c-9b02-720ee4c4c94d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.632232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53464-d8d2-480c-9b02-720ee4c4c94d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.647527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b53464-d8d2-480c-9b02-720ee4c4c94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-52b53464-d8d2-480c-9b02-720ee4c4c94d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:11.653834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:11.654712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:11.655540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:11.657707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 90/184] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:11.659229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cf683-f143-4943-9ef1-46d642e43a0d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.659463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cf683-f143-4943-9ef1-46d642e43a0d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.659739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cf683-f143-4943-9ef1-46d642e43a0d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.665612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 91/185] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:11.666605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cf683-f143-4943-9ef1-46d642e43a0d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:11.733482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d71972-9578-4df6-afa4-4f339436e25e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.772690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ee59d-87bb-486a-a9bc-f227e7d9a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.773351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee59d-87bb-486a-a9bc-f227e7d9a63f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.773634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee59d-87bb-486a-a9bc-f227e7d9a63f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.773906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee59d-87bb-486a-a9bc-f227e7d9a63f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.788206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cf683-f143-4943-9ef1-46d642e43a0d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.797273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:11.824418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.825058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.825597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.825878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.827010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:11.828905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:11.836440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 92/186] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:11.836440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:11.843841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ee59d-87bb-486a-a9bc-f227e7d9a63f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:11.845892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ee59d-87bb-486a-a9bc-f227e7d9a63f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:11.896773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:11.937723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951322b-141c-4a25-ad3b-714666930e21 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:11.944851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 95/187] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:11.946069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc031a-bb96-41ee-91b4-d9444e3664d4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.946347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc031a-bb96-41ee-91b4-d9444e3664d4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.946615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc031a-bb96-41ee-91b4-d9444e3664d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.965348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6efc031a-bb96-41ee-91b4-d9444e3664d4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:11.966577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6efc031a-bb96-41ee-91b4-d9444e3664d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:11.973803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:11.974409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:11.974690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:11.974962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:11.975655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:11.975960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:11.977328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:11.985313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 93/188] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:11.988219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.017671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:12.037299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 96/189] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:12.038119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc031a-bb96-41ee-91b4-d9444e3664d4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.092788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8bf3-6d9d-47bb-ad67-c3708341db95 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.113606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:12.129132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.129988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.130270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.130541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.131187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:12.132648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:12.153335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc031a-bb96-41ee-91b4-d9444e3664d4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.154701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 94/190] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:11 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:09:12.155522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.195761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.196979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.197541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.198073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.212429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:12.218367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:12.219332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:12.220183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:12.222694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 97/191] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:12.223865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.279792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:12.295591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db51c64-0235-4e25-a951-7feca48fc489 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.341438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.342083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.342360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.342629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.343893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:12.345410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:12.347073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 95/192] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:12.348773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.350393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5c85f-4442-421f-bb90-d0250c382d20 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.388726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.389367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.390324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.390324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] PATH_INFO: `/v3/users/5530daba6bd44f3a93c96b48f602abd8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.405003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:12.407875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] RBAC: Authorizing `identity:get_user(user_id=5530daba6bd44f3a93c96b48f602abd8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:12.409368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:12.411265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 98/193] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/users/5530daba6bd44f3a93c96b48f602abd8 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:12.412880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.478023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b30d71-ebcd-4543-ad23-73889922b048 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.527264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.528910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.528910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.528910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.529645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:12.530072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:12.531623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:12.539053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:12.547358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 96/194] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:12.547635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d855e-0b45-4489-bd23-e5961a79ada4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.548259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.589442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.590232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.590723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.591898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.604822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:12.612342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:12.613437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:12.614417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:12.616221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 99/195] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:12.616929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.678346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1618-973d-4115-bcd2-3a5498a38e6b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.686519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:12.718067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.718859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.719278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.719700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.720663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] RBAC: Adding query filter params (role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=a740d61e1d9f4107897b20c8ed8d9140) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:12.721068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:12.722728 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:12.727636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc6853-fd0c-4e21-9a45-373ac7247cbc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.729537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 97/196] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/role_assignments?user.id=a740d61e1d9f4107897b20c8ed8d9140&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:12.736610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:12.775987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.777078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.779043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.780342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.851549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:12.898031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:12.899824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:12.917801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9f57-18fc-4569-88d8-e000f87795c5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:12.969387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:12.970932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:12.971438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:12.971906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] PATH_INFO: `/v3/users/5530daba6bd44f3a93c96b48f602abd8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:12.974597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] RBAC: Authorizing `identity:get_user(user_id=5530daba6bd44f3a93c96b48f602abd8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:12.977037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:12.978881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 98/197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/users/5530daba6bd44f3a93c96b48f602abd8 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:12.979725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.037114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.045703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 100/198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:13.046514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.109793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c937283-a015-4c81-b19b-6cde6fa12534 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.143427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.156838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:13.158366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:13.158853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:13.159314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:13.162730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:13.163245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:13.164910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:13.179550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 99/199] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:13.180719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.190286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06226ef-2bf5-43e9-aa95-e799c61d473a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.226502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:13.226866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:13.227145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:13.227441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:13.292251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.296461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c3ea-b692-42d0-ad37-9638c8ac1b93 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.305540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:13.307253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:13.333278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:13.334298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:13.334789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:13.335278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:13.336936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:13.338568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:13.340484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:13.341475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.373437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.419507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 101/201] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:13.425056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.450673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074fb4-9299-4a4c-a7c9-56315783de69 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.490810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:13.491579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:13.492061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:13.492442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] PATH_INFO: `/v3/users/5f9cfa189ce84c178ca0fa78973cfefe` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:13.493785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] RBAC: Authorizing `identity:get_user(user_id=5f9cfa189ce84c178ca0fa78973cfefe)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:13.495540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:13.497473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/users/5f9cfa189ce84c178ca0fa78973cfefe => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:13.502849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.543412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.546093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bacb2-429a-42f7-b720-25e9a2512e01 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.595449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:13.596301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:13.597000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:13.597420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:13.598871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=5530daba6bd44f3a93c96b48f602abd8) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:13.599485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:13.601366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:13.608909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/role_assignments?user.id=5530daba6bd44f3a93c96b48f602abd8&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:13.610364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.624347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ea5a-04f8-4f02-8747-1a4a97bb52b2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.642865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.696256 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:13.698539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:13.698968 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:13.699262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:13.700660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:13.703569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:13.706000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:13.716420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:13.742736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b3065-b605-47c4-a771-1427ff2be085 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.785398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:13.786734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:13.787478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:13.787926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:13.869067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:13.871792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:13.900335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.938149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b033a-011c-4382-ab77-56f61a567692 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:13.949305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:13.990220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 103/205] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:13.995825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:14.024324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:14.024938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.025217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.025486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.026223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] RBAC: Adding query filter params (role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=5530daba6bd44f3a93c96b48f602abd8) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:14.026530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:14.028021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:14.041538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 103/206] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/role_assignments?user.id=5530daba6bd44f3a93c96b48f602abd8&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:14.126420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045aeef-a4e0-4c56-a88f-d828267198ad None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:14.153185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:14.165634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e5559-e4d2-407b-8ee0-6c62d4663380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:14.166277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e5559-e4d2-407b-8ee0-6c62d4663380 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.166555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e5559-e4d2-407b-8ee0-6c62d4663380 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.166827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e5559-e4d2-407b-8ee0-6c62d4663380 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.167985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e5559-e4d2-407b-8ee0-6c62d4663380 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:14.169447 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e5559-e4d2-407b-8ee0-6c62d4663380 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:14.171506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:13 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:14.180529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:14.334288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d112-3872-4878-9d2c-b7bac2977861 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:14.346537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621d23c-7f3a-42e3-aa4c-e53cd3ca6845 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.346856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621d23c-7f3a-42e3-aa4c-e53cd3ca6845 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.347161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621d23c-7f3a-42e3-aa4c-e53cd3ca6845 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.348557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 105/208] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:14.353662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289b72c-57c5-492a-b569-c1dd92e88a2c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.353945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289b72c-57c5-492a-b569-c1dd92e88a2c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.354221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289b72c-57c5-492a-b569-c1dd92e88a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.373564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d289b72c-57c5-492a-b569-c1dd92e88a2c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:14.374787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d289b72c-57c5-492a-b569-c1dd92e88a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:14.387510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400f03-7dbc-442a-8cac-9d8f71e59f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:14.388141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400f03-7dbc-442a-8cac-9d8f71e59f9e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.388423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400f03-7dbc-442a-8cac-9d8f71e59f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.388698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400f03-7dbc-442a-8cac-9d8f71e59f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.389436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400f03-7dbc-442a-8cac-9d8f71e59f9e None admin] RBAC: Adding query filter params (role.id=c020279e20bc478088b9dee61b83fee6, scope.project.id=020e792f68e2488e84a2d16ea12d0c27, user.id=5f9cfa189ce84c178ca0fa78973cfefe) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:14.389751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400f03-7dbc-442a-8cac-9d8f71e59f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:14.391212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400f03-7dbc-442a-8cac-9d8f71e59f9e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:14.404697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 104/209] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:14 2022] GET /identity/v3/role_assignments?user.id=5f9cfa189ce84c178ca0fa78973cfefe&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=c020279e20bc478088b9dee61b83fee6 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:14.461138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 106/210] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:14.494153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c679a4-fdd7-4a5c-b25d-709bff23849b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.494802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c679a4-fdd7-4a5c-b25d-709bff23849b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.495303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c679a4-fdd7-4a5c-b25d-709bff23849b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.497273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 105/211] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:14.503415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185368d-e7a8-4e92-a9e0-477298984136 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.504029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185368d-e7a8-4e92-a9e0-477298984136 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.504499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185368d-e7a8-4e92-a9e0-477298984136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.524486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3185368d-e7a8-4e92-a9e0-477298984136 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:14.526049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3185368d-e7a8-4e92-a9e0-477298984136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:14.630046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 107/212] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:14.760690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c679a4-fdd7-4a5c-b25d-709bff23849b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:14.794054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:14.870723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c679a4-fdd7-4a5c-b25d-709bff23849b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:14.909026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:14.909632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:14.909919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:14.910191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:14.921227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:14.926805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:14.927713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:14.928487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:14.935289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185368d-e7a8-4e92-a9e0-477298984136 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:14.975498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:14.996650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:15.057169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185368d-e7a8-4e92-a9e0-477298984136 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:15.101920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:15.102536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.102817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.103123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.104344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:15.104791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:15.106571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:15.107457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:15.119139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cfb73-ae04-499d-b156-47f3a05b4057 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:15.123466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 108/214] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:15.126800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:15.168886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:15.169445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.169720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.169996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.171815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:15.173832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:15.179473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:15.183451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:15.272397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f989c-cf12-4f6e-a4ef-76681d641a77 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:15.291279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:15.319124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:15.319802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.320090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.320365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] PATH_INFO: `/v3/users/ae0f1c9826fc4f56af6eab0f56ced962` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.321377 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75137709-c87b-4300-9246-ec4eb910b119 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:15.337218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] RBAC: Authorizing `identity:get_user(user_id=ae0f1c9826fc4f56af6eab0f56ced962)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:15.338962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:15.341654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 109/216] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:15 2022] GET /identity/v3/users/ae0f1c9826fc4f56af6eab0f56ced962 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:15.348103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:15.380168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:15.381194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.381675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.382145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.383003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:15.384701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:15.411581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 108/217] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:15 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:09:15.469106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a2885-1b24-475c-9665-0cd2b70bc4ba None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:15.513283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:15.513911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.514192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.514466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.560697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:15.588216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:15.589694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:15.699546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 110/218] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:09:15.705808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:15.726496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:15.821375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5df0-356e-4f03-b087-1c3d5e5f6a4f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:15.862947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe5787-bdaf-4e3b-8874-810bf7bac548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:15.863624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5787-bdaf-4e3b-8874-810bf7bac548 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.863906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5787-bdaf-4e3b-8874-810bf7bac548 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.864180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5787-bdaf-4e3b-8874-810bf7bac548 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.865347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe5787-bdaf-4e3b-8874-810bf7bac548 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:15.866809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe5787-bdaf-4e3b-8874-810bf7bac548 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:15.868504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 109/219] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:15 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:15.874525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:15.927256 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae33e1a-c7fe-4b08-92bd-63d7c08eba98 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.927603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae33e1a-c7fe-4b08-92bd-63d7c08eba98 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.927841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae33e1a-c7fe-4b08-92bd-63d7c08eba98 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.929340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 110/220] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:15.935482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad559a-9bab-4a8a-99bc-87beb2322e3d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:15.935769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad559a-9bab-4a8a-99bc-87beb2322e3d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:15.936046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad559a-9bab-4a8a-99bc-87beb2322e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:15.977897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b7ad559a-9bab-4a8a-99bc-87beb2322e3d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:15.979008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b7ad559a-9bab-4a8a-99bc-87beb2322e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:16.007733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:16.042070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dff29-384f-48f2-ab4e-0eb0f386947c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:16.099881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e472aad-da06-4260-ac04-9e240ce08d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:16.100492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e472aad-da06-4260-ac04-9e240ce08d14 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:16.100766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e472aad-da06-4260-ac04-9e240ce08d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:16.101035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e472aad-da06-4260-ac04-9e240ce08d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:16.101757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e472aad-da06-4260-ac04-9e240ce08d14 None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=ae0f1c9826fc4f56af6eab0f56ced962) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:16.102062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e472aad-da06-4260-ac04-9e240ce08d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:16.103531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e472aad-da06-4260-ac04-9e240ce08d14 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:16.110378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 111/221] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:15 2022] GET /identity/v3/role_assignments?user.id=ae0f1c9826fc4f56af6eab0f56ced962&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:16.136922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 111/222] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:16.271723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374ac3-38b1-4ce1-8c52-a1cd119c195f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:16.272149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374ac3-38b1-4ce1-8c52-a1cd119c195f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:16.272685 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374ac3-38b1-4ce1-8c52-a1cd119c195f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:16.274984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 112/223] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:16.280008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19743bc-62f3-4191-8e25-e42e71a6ba1d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:16.280297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19743bc-62f3-4191-8e25-e42e71a6ba1d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:16.280575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19743bc-62f3-4191-8e25-e42e71a6ba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:16.301252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d19743bc-62f3-4191-8e25-e42e71a6ba1d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:16.302465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d19743bc-62f3-4191-8e25-e42e71a6ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:16.312805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:16.398050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 112/224] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:16.541407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374ac3-38b1-4ce1-8c52-a1cd119c195f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:16.689081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374ac3-38b1-4ce1-8c52-a1cd119c195f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:16.744945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:16.745602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:16.745914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:16.746097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:16.751675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:16.758160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:16.763192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:16.764150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:16.764952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 113/225] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:16.778861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19743bc-62f3-4191-8e25-e42e71a6ba1d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:16.779039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:16.950486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c710ba-6c43-4f2b-a70f-7b55cf7ddd91 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:16.979408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19743bc-62f3-4191-8e25-e42e71a6ba1d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.035132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.035785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.036163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.036440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.037111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:17.037409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.038781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.044095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.044744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.045026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.045303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.047595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:17.053456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:17.067643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:17.077667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:17.095917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:17.096828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:17.097601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:17.108319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:17.175751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3916e-ad26-492b-8562-1e19db9fe908 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.210658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.211214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.211526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.211840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] PATH_INFO: `/v3/users/5530daba6bd44f3a93c96b48f602abd8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.213010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] RBAC: Authorizing `identity:get_user(user_id=5530daba6bd44f3a93c96b48f602abd8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.214449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.216416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:17 2022] GET /identity/v3/users/5530daba6bd44f3a93c96b48f602abd8 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:17.225604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:17.227225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:17.279088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d45e9-8c8e-4d2b-a237-cb6f92a043d1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.326877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.327518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.327795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.328062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.328740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:17.329042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.330466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.346260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:17.352517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:17.372233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:17.416689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df4c0-d3c8-4b77-a8f3-2796567115e7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.482314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139fb8-5d1a-4cc3-b5f0-b3d1d6035d8e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.503946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:17.519107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.519782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.520056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.520332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] PATH_INFO: `/v3/users/5530daba6bd44f3a93c96b48f602abd8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.521582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] RBAC: Authorizing `identity:get_user(user_id=5530daba6bd44f3a93c96b48f602abd8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.522430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087332-4167-448c-a951-bdc45493f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.523036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.523566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087332-4167-448c-a951-bdc45493f523 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.524045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087332-4167-448c-a951-bdc45493f523 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.524510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087332-4167-448c-a951-bdc45493f523 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.524934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 116/230] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:17 2022] GET /identity/v3/users/5530daba6bd44f3a93c96b48f602abd8 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:17.529937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087332-4167-448c-a951-bdc45493f523 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.530453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:17.531921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087332-4167-448c-a951-bdc45493f523 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.534590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 115/231] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:17 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:17.544276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087332-4167-448c-a951-bdc45493f523 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:17.697498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087332-4167-448c-a951-bdc45493f523 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.705891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd9559-0847-43a1-9a61-07f1cdc2b4cc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.736132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.736863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.737146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.737419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6/users/5530daba6bd44f3a93c96b48f602abd8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.739352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c6f2245555844ccae44339351591ea6, user_id=5530daba6bd44f3a93c96b48f602abd8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.741088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.758576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:17 2022] PUT /identity/v3/projects/1c6f2245555844ccae44339351591ea6/users/5530daba6bd44f3a93c96b48f602abd8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:17.778653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c044ed-be53-401b-bfb4-d5274eaf9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.779397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c044ed-be53-401b-bfb4-d5274eaf9af6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.779761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c044ed-be53-401b-bfb4-d5274eaf9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.780043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c044ed-be53-401b-bfb4-d5274eaf9af6 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.781234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c044ed-be53-401b-bfb4-d5274eaf9af6 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.783458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c044ed-be53-401b-bfb4-d5274eaf9af6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.785342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:17 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:17.791577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:17.794681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:17.904577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f98d6-0f3c-47bc-a00e-56ff7e6e5b19 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:17.941660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087e8e-85be-4f39-be1f-6cd42fb7891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:17.942336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087e8e-85be-4f39-be1f-6cd42fb7891b None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.942613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087e8e-85be-4f39-be1f-6cd42fb7891b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.942962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087e8e-85be-4f39-be1f-6cd42fb7891b None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6/users/5530daba6bd44f3a93c96b48f602abd8/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.945177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54087e8e-85be-4f39-be1f-6cd42fb7891b None admin] RBAC: Authorizing `identity:create_grant(project_id=1c6f2245555844ccae44339351591ea6, user_id=5530daba6bd44f3a93c96b48f602abd8, role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:17.946639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54087e8e-85be-4f39-be1f-6cd42fb7891b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:17.976992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:17 2022] PUT /identity/v3/projects/1c6f2245555844ccae44339351591ea6/users/5530daba6bd44f3a93c96b48f602abd8/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:17.998032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5cdd2-2b61-499e-8634-4822810bda88 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:17.998032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5cdd2-2b61-499e-8634-4822810bda88 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:17.998032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5cdd2-2b61-499e-8634-4822810bda88 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:17.998836 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:18.004331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e455d-9c0a-4fa8-849b-b4bfe8994fde None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:18.004823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e455d-9c0a-4fa8-849b-b4bfe8994fde None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:18.005364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e455d-9c0a-4fa8-849b-b4bfe8994fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:18.028281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e46e455d-9c0a-4fa8-849b-b4bfe8994fde None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:18.029564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e46e455d-9c0a-4fa8-849b-b4bfe8994fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:18.099946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:18.111521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 118/236] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:18.237621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18eaa-b367-42d3-a411-7f01624f0d25 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:18.238082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18eaa-b367-42d3-a411-7f01624f0d25 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:18.238590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18eaa-b367-42d3-a411-7f01624f0d25 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:18.240171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 119/237] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:18.246053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281371-1d7a-4e47-ac30-c8debe11dcf9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:18.246337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281371-1d7a-4e47-ac30-c8debe11dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:18.246612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281371-1d7a-4e47-ac30-c8debe11dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:18.269603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e9281371-1d7a-4e47-ac30-c8debe11dcf9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:18.270729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e9281371-1d7a-4e47-ac30-c8debe11dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:18.356067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 119/238] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:18.446251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf18eaa-b367-42d3-a411-7f01624f0d25 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:18.491927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329944-398f-441f-9cfa-f32ebd06286b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:18.492535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329944-398f-441f-9cfa-f32ebd06286b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:18.493035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329944-398f-441f-9cfa-f32ebd06286b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:18.494575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 120/239] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:18.499964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed481-dd81-493c-b2ad-a85ea615de35 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:18.500312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed481-dd81-493c-b2ad-a85ea615de35 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:18.500790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed481-dd81-493c-b2ad-a85ea615de35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:18.517444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:18.537694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-349ed481-dd81-493c-b2ad-a85ea615de35 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:18.539319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-349ed481-dd81-493c-b2ad-a85ea615de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:18.600261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf18eaa-b367-42d3-a411-7f01624f0d25 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:18.617184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 121/240] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:18.644429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:18.645303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:18.645730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:18.646182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:18.647458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:18.649067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:18.650850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 120/241] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:18.656293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed481-dd81-493c-b2ad-a85ea615de35 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:18.668900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:18.723749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:18.775076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed481-dd81-493c-b2ad-a85ea615de35 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:18.814226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:18.815090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:18.815662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:18.816087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:18.816893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:18.818557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:18.843623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 122/242] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:18 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:09:18.906186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:18.937570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f1b5-0e57-4fb0-b01a-92675fb819fa None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.001649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:19.020858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.021602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.021882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.022154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.033489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c402e-8b95-479f-8cc7-7e0a3c886800 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.035224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:19.040844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:19.041728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:19.042514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 121/243] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:19.048837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.068438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:19.084802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.085439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.085714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.086058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.099832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:19.106660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:19.107591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:19.108391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 123/244] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:19.131187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.176335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f304-6fb1-45ea-b5d4-d2939878ed6e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.214365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.215354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.216343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.216852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.217854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:19.218366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:19.221899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:19.237016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 122/245] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:19.244868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.250546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fcfed-f2c0-4391-8edd-1f73f211cb29 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.295180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.296216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.296853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.297342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.298303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:19.301346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:19.303281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:19.306736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:19.319321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 124/246] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:19.326025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.372984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:19.380928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fa133-d8ed-4989-8ce8-cf562c0c3728 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.435394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.436376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.436883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.437363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] PATH_INFO: `/v3/users/a33f6f4d73d240a8b4c9ff9bf14d2d61` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.455245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] RBAC: Authorizing `identity:get_user(user_id=a33f6f4d73d240a8b4c9ff9bf14d2d61)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:19.457083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:19.459000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 123/247] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:19 2022] GET /identity/v3/users/a33f6f4d73d240a8b4c9ff9bf14d2d61 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:19.465046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.473997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c5eac-5dcc-4454-9e0f-cd2d36e49a30 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.521613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.522667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.522950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.523224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] PATH_INFO: `/v3/users/ae0f1c9826fc4f56af6eab0f56ced962` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.524645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0f1c9826fc4f56af6eab0f56ced962)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:19.526372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:19.529055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 125/248] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:19 2022] GET /identity/v3/users/ae0f1c9826fc4f56af6eab0f56ced962 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:19.539309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.592586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6b3f0-f71c-4478-ad9d-7364e05f2c17 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.594872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:19.644577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.645932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.646416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.647238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.670158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:19.675397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1706c-4aba-45fb-a3af-749517de5691 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.717418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.718434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.718783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.719129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.720640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:19.722874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:19.725848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 126/249] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:19 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:19.731203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.740818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:19.743046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:19.868196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c07ff-1cc8-42a3-a276-c40b0ee8bfc1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:19.927660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 124/250] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:09:19.930928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:19.931622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:19.932492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:19.932492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6/users/ae0f1c9826fc4f56af6eab0f56ced962/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:19.934107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:19.936258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:19.937772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c6f2245555844ccae44339351591ea6, user_id=ae0f1c9826fc4f56af6eab0f56ced962, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:19.940071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:19.965668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 127/251] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:19 2022] PUT /identity/v3/projects/1c6f2245555844ccae44339351591ea6/users/ae0f1c9826fc4f56af6eab0f56ced962/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:09:20.089474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad1c1-9f9b-4556-adee-e0eddf58bd2d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:20.131302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2d6d7-a926-49f8-ae99-fd41e41b9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:20.131889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d6d7-a926-49f8-ae99-fd41e41b9cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:20.132162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d6d7-a926-49f8-ae99-fd41e41b9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:20.132433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d6d7-a926-49f8-ae99-fd41e41b9cb3 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:20.135809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2d6d7-a926-49f8-ae99-fd41e41b9cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:20.137326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2d6d7-a926-49f8-ae99-fd41e41b9cb3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:20.139237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 125/252] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:19 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:20.145149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:20.181392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:20.260096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682100fe-9274-490e-ad56-629597ba6e63 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:20.299826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63774ba4-d84d-4538-9aea-e0c182478961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:20.300442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774ba4-d84d-4538-9aea-e0c182478961 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:20.300779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774ba4-d84d-4538-9aea-e0c182478961 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:20.301049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774ba4-d84d-4538-9aea-e0c182478961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:20.301983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63774ba4-d84d-4538-9aea-e0c182478961 None admin] RBAC: Adding query filter params (role.id=c020279e20bc478088b9dee61b83fee6, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=a33f6f4d73d240a8b4c9ff9bf14d2d61) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:20.302315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63774ba4-d84d-4538-9aea-e0c182478961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:20.303998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63774ba4-d84d-4538-9aea-e0c182478961 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:20.310511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 128/253] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:20 2022] GET /identity/v3/role_assignments?user.id=a33f6f4d73d240a8b4c9ff9bf14d2d61&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=c020279e20bc478088b9dee61b83fee6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:20.340600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58271dab-6e7b-46c7-941f-18325d9061ab None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:20.340946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58271dab-6e7b-46c7-941f-18325d9061ab None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:20.341214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58271dab-6e7b-46c7-941f-18325d9061ab None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:20.342645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 126/254] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:20.350497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e56066-ee67-47b6-b92d-3071c498a82b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:20.350799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e56066-ee67-47b6-b92d-3071c498a82b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:20.351048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e56066-ee67-47b6-b92d-3071c498a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:20.376469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d7e56066-ee67-47b6-b92d-3071c498a82b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:20.377697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d7e56066-ee67-47b6-b92d-3071c498a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:20.468591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 129/255] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:20.828135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58271dab-6e7b-46c7-941f-18325d9061ab None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:20.912888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:20.949216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58271dab-6e7b-46c7-941f-18325d9061ab None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:20.952096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b86184-8afe-4cc1-a9b4-a9c279a8bd24 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:20.952384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b86184-8afe-4cc1-a9b4-a9c279a8bd24 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:20.953485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b86184-8afe-4cc1-a9b4-a9c279a8bd24 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:20.959481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 130/256] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:20.964640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa90c-4281-4079-8f48-bce8bfa0d654 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:20.964923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa90c-4281-4079-8f48-bce8bfa0d654 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:20.965255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa90c-4281-4079-8f48-bce8bfa0d654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:20.989716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:20.990709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:20.991183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:20.992120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:21.002987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bb7aa90c-4281-4079-8f48-bce8bfa0d654 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:21.004239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bb7aa90c-4281-4079-8f48-bce8bfa0d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:21.009084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:21.014438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:21.016295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:21.017684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:21.021631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 127/257] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:21.028102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:21.029102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:21.114216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 131/258] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:21.209733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f79c-cad8-4d19-acfc-25f44f5ee97d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:21.254327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:21.264957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:21.266064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:21.267591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:21.267701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:21.268298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:21.268873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:21.270677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:21.279462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 128/259] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:21.284862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aa90c-4281-4079-8f48-bce8bfa0d654 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:21.409764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aa90c-4281-4079-8f48-bce8bfa0d654 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:21.450845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:21.451570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:21.451849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:21.452115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] PATH_INFO: `/v3/users/5530daba6bd44f3a93c96b48f602abd8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:21.453250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] RBAC: Authorizing `identity:get_user(user_id=5530daba6bd44f3a93c96b48f602abd8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:21.454749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:21.456349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 132/260] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:21 2022] GET /identity/v3/users/5530daba6bd44f3a93c96b48f602abd8 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:21.461979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:21.608130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346337-f7ca-4c22-8797-b23bb3638b42 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:21.660159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:21.660699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:21.660980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:21.661251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:21.737265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:21.737556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:21.747287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:21.749125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:21.779318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:21.939085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 129/261] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:21.944797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:21.955221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e065a1-7187-44a9-a1d3-b9f9bda6b803 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:22.022453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb74b2-11dd-4504-a015-384dfcfd6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:22.023433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb74b2-11dd-4504-a015-384dfcfd6f12 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.023913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb74b2-11dd-4504-a015-384dfcfd6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.024399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb74b2-11dd-4504-a015-384dfcfd6f12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.035811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb74b2-11dd-4504-a015-384dfcfd6f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-65fb74b2-11dd-4504-a015-384dfcfd6f12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:22.041445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:22.042317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:22.043089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:22.045661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 133/262] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:22.047043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba962979-5c81-4fbb-aa45-4ca482ecc800 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.047547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba962979-5c81-4fbb-aa45-4ca482ecc800 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.048074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba962979-5c81-4fbb-aa45-4ca482ecc800 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.050019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 134/263] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:22.055331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ad29b-feaf-4330-953b-d67237b443ea None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.055880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ad29b-feaf-4330-953b-d67237b443ea None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.056371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ad29b-feaf-4330-953b-d67237b443ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.067776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:22.072547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86aad5-9d50-474a-976e-c19c15df79d5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:22.108422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-117ad29b-feaf-4330-953b-d67237b443ea None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:22.109632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-117ad29b-feaf-4330-953b-d67237b443ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:22.111770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:22.112857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.113313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.113761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.115055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:22.117682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:22.119563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 130/264] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:21 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:22.120624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:22.233976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e5985-3a2a-434c-86dd-e0c36e180716 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:22.250541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 135/265] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:22.252145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ad29b-feaf-4330-953b-d67237b443ea None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:22.268035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:22.295647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:22.296602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.297138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.297631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.299410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:22.307427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:22.309620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:22.326436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 131/266] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:22.332461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:22.378805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:22.427247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ad29b-feaf-4330-953b-d67237b443ea None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:22.501060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad49a7-7352-4ce7-ab7a-86eedc7c2d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:22.501655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad49a7-7352-4ce7-ab7a-86eedc7c2d9a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.501930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad49a7-7352-4ce7-ab7a-86eedc7c2d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.502200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad49a7-7352-4ce7-ab7a-86eedc7c2d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.502934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad49a7-7352-4ce7-ab7a-86eedc7c2d9a None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=5530daba6bd44f3a93c96b48f602abd8) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:22.503243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad49a7-7352-4ce7-ab7a-86eedc7c2d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:22.504711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad49a7-7352-4ce7-ab7a-86eedc7c2d9a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:22.517203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 136/267] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:22 2022] GET /identity/v3/role_assignments?user.id=5530daba6bd44f3a93c96b48f602abd8&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:22.524647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e251b-9b0e-4514-9d3f-07dc37203f86 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.524928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e251b-9b0e-4514-9d3f-07dc37203f86 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.525261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e251b-9b0e-4514-9d3f-07dc37203f86 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.526856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 137/268] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:22.533174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de28f-76cc-4ca4-9d3e-d48255a9aa9e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.533487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de28f-76cc-4ca4-9d3e-d48255a9aa9e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.533690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de28f-76cc-4ca4-9d3e-d48255a9aa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.559536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d96aad-1cca-44c6-a941-15b04a38a69e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:22.568526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-404de28f-76cc-4ca4-9d3e-d48255a9aa9e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:22.569820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-404de28f-76cc-4ca4-9d3e-d48255a9aa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:22.660281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:22.660935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.661204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.661470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] PATH_INFO: `/v3/users/5530daba6bd44f3a93c96b48f602abd8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:22.662732 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5530daba6bd44f3a93c96b48f602abd8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:22.664234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:22.666822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 132/269] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:22 2022] GET /identity/v3/users/5530daba6bd44f3a93c96b48f602abd8 => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:22.672555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:22.722680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 138/270] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:22.766185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404de28f-76cc-4ca4-9d3e-d48255a9aa9e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:22.769266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:22.897313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:22.921539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8e6a-7327-483f-aa6d-7b335df947b5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:22.951758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404de28f-76cc-4ca4-9d3e-d48255a9aa9e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:22.993311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:22.994237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:22.994621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:22.994994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.005118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0854c6-a05b-4ee0-8982-90ebc1e7b136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.006295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0854c6-a05b-4ee0-8982-90ebc1e7b136 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.006774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0854c6-a05b-4ee0-8982-90ebc1e7b136 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.007246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0854c6-a05b-4ee0-8982-90ebc1e7b136 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.020959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0854c6-a05b-4ee0-8982-90ebc1e7b136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ff0854c6-a05b-4ee0-8982-90ebc1e7b136 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:23.027529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:23.028418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:23.029653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 139/271] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:23.030531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defb58-814c-49df-9669-221ba02764ba None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.030531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defb58-814c-49df-9669-221ba02764ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.030648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defb58-814c-49df-9669-221ba02764ba None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.033478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 140/272] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:23.038294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15defb58-814c-49df-9669-221ba02764ba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.089513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.090979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.119561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:23.161534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15defb58-814c-49df-9669-221ba02764ba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.196561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca309811-d6a5-48e9-a629-a7061704478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.197156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309811-d6a5-48e9-a629-a7061704478b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.197428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309811-d6a5-48e9-a629-a7061704478b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.197690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309811-d6a5-48e9-a629-a7061704478b None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.198232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:23.198337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca309811-d6a5-48e9-a629-a7061704478b None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:23.198627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca309811-d6a5-48e9-a629-a7061704478b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.200095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca309811-d6a5-48e9-a629-a7061704478b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.212792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 141/273] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:23.212792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457584e4-4fd5-4da9-bab7-0dae17366ac1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.212792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457584e4-4fd5-4da9-bab7-0dae17366ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.212792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457584e4-4fd5-4da9-bab7-0dae17366ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.219928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 133/274] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:23.219928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.231612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-457584e4-4fd5-4da9-bab7-0dae17366ac1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:23.232784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-457584e4-4fd5-4da9-bab7-0dae17366ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:23.301546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 142/275] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:23.302314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457584e4-4fd5-4da9-bab7-0dae17366ac1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.317559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ad33-df05-46d0-90d6-a9d1ed38c375 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.363152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:23.364274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.364773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.365052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.365326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.366445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.367938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.369504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 134/276] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:23.369504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.419708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457584e4-4fd5-4da9-bab7-0dae17366ac1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.430031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:23.453890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337ffb1-dd38-4e91-a16e-57f2a3192a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.454542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337ffb1-dd38-4e91-a16e-57f2a3192a2d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.454817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337ffb1-dd38-4e91-a16e-57f2a3192a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.455095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337ffb1-dd38-4e91-a16e-57f2a3192a2d None admin] PATH_INFO: `/v3/users/32572f6f30904e4f84205c6c40f1aba9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.468066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337ffb1-dd38-4e91-a16e-57f2a3192a2d None admin] RBAC: Authorizing `identity:get_user(user_id=32572f6f30904e4f84205c6c40f1aba9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.469521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337ffb1-dd38-4e91-a16e-57f2a3192a2d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.476400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 143/277] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/users/32572f6f30904e4f84205c6c40f1aba9 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:23.476400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055224-7eb3-446a-b5e1-953f1cd05b55 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.476400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055224-7eb3-446a-b5e1-953f1cd05b55 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.476400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055224-7eb3-446a-b5e1-953f1cd05b55 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.476400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 144/278] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:23.476400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09055224-7eb3-446a-b5e1-953f1cd05b55 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.482337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f23c-fc9b-4ce1-8aa0-270383815320 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.518011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.518941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.519413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.519827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.521212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.522929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.529561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 135/279] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:23.530503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.579551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09055224-7eb3-446a-b5e1-953f1cd05b55 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.592569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:23.615710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37928f5-7063-4d85-a611-68682fc023d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.616319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37928f5-7063-4d85-a611-68682fc023d6 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.616590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37928f5-7063-4d85-a611-68682fc023d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.616857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37928f5-7063-4d85-a611-68682fc023d6 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.617494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37928f5-7063-4d85-a611-68682fc023d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.618934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37928f5-7063-4d85-a611-68682fc023d6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.630767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1a5c-9440-4585-8f8a-65a0bc302c9f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.639629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 145/280] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:23 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:09:23.640814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c55e-4364-42b5-9cdc-4d72c2f7d6a0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.641095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c55e-4364-42b5-9cdc-4d72c2f7d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.641364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c55e-4364-42b5-9cdc-4d72c2f7d6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.661750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8f66c55e-4364-42b5-9cdc-4d72c2f7d6a0 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:23.662977 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8f66c55e-4364-42b5-9cdc-4d72c2f7d6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:23.664024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:23.675933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805038-3898-4095-a112-82663d930af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.676847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805038-3898-4095-a112-82663d930af6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.677295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805038-3898-4095-a112-82663d930af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.677569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805038-3898-4095-a112-82663d930af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.678324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805038-3898-4095-a112-82663d930af6 None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, user.id=32572f6f30904e4f84205c6c40f1aba9, scope.system=all) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:23.678618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805038-3898-4095-a112-82663d930af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.680153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805038-3898-4095-a112-82663d930af6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.689248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 136/281] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/role_assignments?user.id=32572f6f30904e4f84205c6c40f1aba9&scope.system=all&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:23.689990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805038-3898-4095-a112-82663d930af6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.743033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 146/282] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:23.744067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66c55e-4364-42b5-9cdc-4d72c2f7d6a0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:23.880631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805038-3898-4095-a112-82663d930af6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.915152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66c55e-4364-42b5-9cdc-4d72c2f7d6a0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:23.926879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:23.936121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.936850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.937155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.937490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.938235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] RBAC: Adding query filter params (role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=5530daba6bd44f3a93c96b48f602abd8) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:23.938543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:23.940937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:23.948127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 137/283] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/role_assignments?user.id=5530daba6bd44f3a93c96b48f602abd8&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:23.955414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:23.956072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:23.956349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:23.956617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:23.971126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:23.976304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:23.977267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:23.978068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 147/284] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:23.983902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.036996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.066616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:24.150532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8f5f2-8809-4e15-9c2a-3c63db24aadc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.190651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:24.191264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:24.191561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:24.191829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:24.192493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:24.192791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:24.192994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577452-c5f7-42b6-8a76-4a90cf3ea0ac None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.194185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:24.205016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 138/285] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:24.210625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.249538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:24.250453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:24.250874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:24.251391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:24.278104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:24.285670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:24.286610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:24.287419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:24.288020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 148/286] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:24.294533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.322217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:24.343227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7ee8-cf27-4358-840f-3f66313b2d17 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.362486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:24.384706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:24.385385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:24.385661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:24.385926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] PATH_INFO: `/v3/users/ae0f1c9826fc4f56af6eab0f56ced962` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:24.387192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0f1c9826fc4f56af6eab0f56ced962)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:24.388680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:24.390606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 139/287] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:24 2022] GET /identity/v3/users/ae0f1c9826fc4f56af6eab0f56ced962 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:24.396538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.438179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fa3f0-ec60-43b4-b92d-e213632546b1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.474574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:24.475238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:24.475459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:24.475819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:24.476582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:24.476975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:24.478500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:24.487233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 149/288] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:24.492858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.518622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65868d-c638-4d98-9037-008bacef1c76 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.556652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:24.557592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:24.558019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:24.558434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:24.575913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:24.598184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80217-0bac-4f56-a56a-100a7bfdb7dc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.617652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:24.634037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:24.634820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:24.635236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:24.635733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] PATH_INFO: `/v3/users/a33f6f4d73d240a8b4c9ff9bf14d2d61` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:24.636955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] RBAC: Authorizing `identity:get_user(user_id=a33f6f4d73d240a8b4c9ff9bf14d2d61)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:24.638500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:24.640342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 150/289] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:24 2022] GET /identity/v3/users/a33f6f4d73d240a8b4c9ff9bf14d2d61 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:24.641431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:24.643625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:24.647403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.785595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 140/290] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:24.794750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.850412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8900ea-828b-4546-b88b-fd88bcf4ed5e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.925388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:24.926298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:24.927671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:24.928153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:24.931165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:24.933011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:24.936831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 151/291] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:24 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:24.943353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:24.953890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:24.971969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161933dd-d3c5-412a-85de-f9167331ee92 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:24.983755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:25.052119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:25.052674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:25.052948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:25.053218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:25.059788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:25.061254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:25.062885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 141/292] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:24 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:25.069205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:25.166276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb29e3-2e03-4c73-8852-46e8d6c04a56 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:25.240990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afea978-53e7-4ef5-872a-6b1e36b95b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:25.241665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea978-53e7-4ef5-872a-6b1e36b95b98 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:25.241948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea978-53e7-4ef5-872a-6b1e36b95b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:25.242223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea978-53e7-4ef5-872a-6b1e36b95b98 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6/users/a33f6f4d73d240a8b4c9ff9bf14d2d61/roles/c020279e20bc478088b9dee61b83fee6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:25.245540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afea978-53e7-4ef5-872a-6b1e36b95b98 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c6f2245555844ccae44339351591ea6, user_id=a33f6f4d73d240a8b4c9ff9bf14d2d61, role_id=c020279e20bc478088b9dee61b83fee6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:25.246981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afea978-53e7-4ef5-872a-6b1e36b95b98 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:25.260000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df525-42f3-4370-b257-0b3743dc0f8a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:25.278679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 152/293] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:09:24 2022] PUT /identity/v3/projects/1c6f2245555844ccae44339351591ea6/users/a33f6f4d73d240a8b4c9ff9bf14d2d61/roles/c020279e20bc478088b9dee61b83fee6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:25.306026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faa037-c9dd-4058-9983-af8b5a489ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:25.306568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faa037-c9dd-4058-9983-af8b5a489ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:25.306840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faa037-c9dd-4058-9983-af8b5a489ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:25.307114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faa037-c9dd-4058-9983-af8b5a489ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:25.307902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faa037-c9dd-4058-9983-af8b5a489ea6 None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=ae0f1c9826fc4f56af6eab0f56ced962) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:25.308209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faa037-c9dd-4058-9983-af8b5a489ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:25.309754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faa037-c9dd-4058-9983-af8b5a489ea6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:25.317997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 142/294] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:25 2022] GET /identity/v3/role_assignments?user.id=ae0f1c9826fc4f56af6eab0f56ced962&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:25.783252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46082c3-5b4f-469a-a9b0-171bd8a1d864 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:25.783782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46082c3-5b4f-469a-a9b0-171bd8a1d864 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:25.783856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46082c3-5b4f-469a-a9b0-171bd8a1d864 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:25.785307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 153/295] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:25.790506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed6fa1-8a5d-4483-86c7-1d9fd19a9712 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:25.791311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed6fa1-8a5d-4483-86c7-1d9fd19a9712 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:25.791819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed6fa1-8a5d-4483-86c7-1d9fd19a9712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:25.812797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-64ed6fa1-8a5d-4483-86c7-1d9fd19a9712 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:25.814345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-64ed6fa1-8a5d-4483-86c7-1d9fd19a9712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:25.825774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:25.884571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 143/296] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:26.160293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46082c3-5b4f-469a-a9b0-171bd8a1d864 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:26.240277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:26.264991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46082c3-5b4f-469a-a9b0-171bd8a1d864 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:26.300475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c765a7-6b07-4adb-aadb-1411e2b691d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:26.301210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c765a7-6b07-4adb-aadb-1411e2b691d5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.301490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c765a7-6b07-4adb-aadb-1411e2b691d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.301760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c765a7-6b07-4adb-aadb-1411e2b691d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.315221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c765a7-6b07-4adb-aadb-1411e2b691d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f6c765a7-6b07-4adb-aadb-1411e2b691d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:26.321300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:26.322162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:26.322966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 154/297] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:26.329988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed6fa1-8a5d-4483-86c7-1d9fd19a9712 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:26.343973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a650f5-42b2-434b-8580-c5f0f80fe855 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.344259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a650f5-42b2-434b-8580-c5f0f80fe855 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.344526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a650f5-42b2-434b-8580-c5f0f80fe855 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.348010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 155/298] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:26.353955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19724af9-e9e7-407a-9175-ee6a20615d1a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.354441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19724af9-e9e7-407a-9175-ee6a20615d1a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.354925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19724af9-e9e7-407a-9175-ee6a20615d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.374395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-19724af9-e9e7-407a-9175-ee6a20615d1a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:26.375756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-19724af9-e9e7-407a-9175-ee6a20615d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:26.442436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed6fa1-8a5d-4483-86c7-1d9fd19a9712 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:26.460923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 156/299] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:26.462237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731918c-9ec3-46d8-b7f2-3c6401040dcd None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.462237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731918c-9ec3-46d8-b7f2-3c6401040dcd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.462429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731918c-9ec3-46d8-b7f2-3c6401040dcd None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.464401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 157/300] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:26.472906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2def5-3e58-491c-b503-efdafa375964 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.473622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2def5-3e58-491c-b503-efdafa375964 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.474450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2def5-3e58-491c-b503-efdafa375964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.478893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:26.479532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.479804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.480069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.480734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:26.481037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:26.482414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:26.493964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 144/301] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:26.499234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:26.499464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6ed2def5-3e58-491c-b503-efdafa375964 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:26.500609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6ed2def5-3e58-491c-b503-efdafa375964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:26.515745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:26.568324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:26.583405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 158/302] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:26.628945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1104e1a-6ed7-469f-b300-01b1aa06ff8a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:26.664294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:26.664920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.665198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.665473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] PATH_INFO: `/v3/users/32572f6f30904e4f84205c6c40f1aba9` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.666598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] RBAC: Authorizing `identity:get_user(user_id=32572f6f30904e4f84205c6c40f1aba9)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:26.668083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:26.669956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 145/303] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:26 2022] GET /identity/v3/users/32572f6f30904e4f84205c6c40f1aba9 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:26.675202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2def5-3e58-491c-b503-efdafa375964 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:26.738470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:26.787778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2def5-3e58-491c-b503-efdafa375964 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:26.820579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:26.828879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:26.830068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.830351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.830790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] PATH_INFO: `/v3/system/users/32572f6f30904e4f84205c6c40f1aba9/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.832522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=32572f6f30904e4f84205c6c40f1aba9, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:26.833918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:26.847431 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 159/304] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Sep 6 04:09:26 2022] PUT /identity/v3/system/users/32572f6f30904e4f84205c6c40f1aba9/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:26.851830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce09f-a2f2-45be-82bd-8c29cd5be41b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:26.894733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:26.895877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:26.897211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:26.898213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:26.898905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:26.919468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:26.927631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:26.928646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:26.929461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:26.932236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 146/305] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:26.940415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:26.972159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:27.045314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b53c3-8e2c-4513-a020-0c16972a4673 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:27.074330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68994b-5fde-4b0e-8bb0-a0d5f3d887c0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:27.095741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:27.096505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:27.096951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:27.097227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:27.098494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:27.099949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:27.106073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 160/306] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:27.107357 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:27.115332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:27.116379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:27.116860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:27.117871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:27.118751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:27.119770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:27.122058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:27.125733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:27.137352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 147/307] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:27.144124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:27.221729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349391f-332f-4d44-87fb-8df689af369f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:27.250351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:27.263169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:27.263749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:27.264023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:27.264285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] PATH_INFO: `/v3/groups` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:27.264911 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:27.266488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:27.283859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74ed0c-8438-421a-a397-d5dc86cf8922 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:27.287451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 161/308] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Sep 6 04:09:27 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:09:27.337576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59489-5fee-435a-858c-ec7d114035cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:27.338227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59489-5fee-435a-858c-ec7d114035cf None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:27.338558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59489-5fee-435a-858c-ec7d114035cf None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:27.338891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59489-5fee-435a-858c-ec7d114035cf None admin] PATH_INFO: `/v3/users/b2862aaa884448efbdceb6af16231385` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:27.355692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a59489-5fee-435a-858c-ec7d114035cf None admin] RBAC: Authorizing `identity:get_user(user_id=b2862aaa884448efbdceb6af16231385)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:27.357339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a59489-5fee-435a-858c-ec7d114035cf None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:27.359107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 148/309] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:27 2022] GET /identity/v3/users/b2862aaa884448efbdceb6af16231385 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:27.365565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:27.456534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823631ab-490f-4cbc-bca8-ec6b06110ac1 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:27.456896 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823631ab-490f-4cbc-bca8-ec6b06110ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:27.457171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823631ab-490f-4cbc-bca8-ec6b06110ac1 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:27.458509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 149/310] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:27.465082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9624d-41e2-4e78-8249-78bffb2da9de None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:27.465362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9624d-41e2-4e78-8249-78bffb2da9de None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:27.465630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9624d-41e2-4e78-8249-78bffb2da9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:27.483680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8a24-fb07-458e-b858-983582f35d12 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:27.488112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-eac9624d-41e2-4e78-8249-78bffb2da9de None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:27.489446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-eac9624d-41e2-4e78-8249-78bffb2da9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:27.525573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:27.526230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:27.526505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:27.526810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:27.527542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] RBAC: Adding query filter params (role.id=c020279e20bc478088b9dee61b83fee6, user.id=b2862aaa884448efbdceb6af16231385, scope.system=all) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:27.527848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:27.529304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:27.536107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 162/311] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Sep 6 04:09:27 2022] GET /identity/v3/role_assignments?user.id=b2862aaa884448efbdceb6af16231385&scope.system=all&role.id=c020279e20bc478088b9dee61b83fee6 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:27.556360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:27.576529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 150/312] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:27.853443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:27.908559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:27.958506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127078e-1782-4a25-b02b-14bb2a390d7f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:28.001650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:28.002541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.003021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.003553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.016378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:28.022350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:28.023193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:28.024004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:28.026594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 163/313] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:28.032142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9624d-41e2-4e78-8249-78bffb2da9de None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:28.135580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9624d-41e2-4e78-8249-78bffb2da9de None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:28.170117 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:28.170714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.170986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.171252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.171937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:28.172233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:28.173634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:28.181879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 151/314] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:28.187308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:28.287578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9a3a9-cbf3-4106-9615-4ad376a5866d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:28.300936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:28.322498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:28.323123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.323411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.323692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] PATH_INFO: `/v3/users/a33f6f4d73d240a8b4c9ff9bf14d2d61` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.324811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] RBAC: Authorizing `identity:get_user(user_id=a33f6f4d73d240a8b4c9ff9bf14d2d61)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:28.326297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:28.333222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 164/315] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:28 2022] GET /identity/v3/users/a33f6f4d73d240a8b4c9ff9bf14d2d61 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:28.334635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:28.386667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:28.438227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8ab3f-ca32-477f-95ec-55a2b3622a09 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:28.472509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:28.473107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.473381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.473647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.545392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:28.546850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:28.594878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:28.654016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 152/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:28.655264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:28.767124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002de25-4292-4738-86a1-386b99ca7925 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:28.803125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515e978-9f86-443b-a0fa-0bb81f5218a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:28.803787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e978-9f86-443b-a0fa-0bb81f5218a3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.804109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e978-9f86-443b-a0fa-0bb81f5218a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.804385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e978-9f86-443b-a0fa-0bb81f5218a3 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.805506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515e978-9f86-443b-a0fa-0bb81f5218a3 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:28.806957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515e978-9f86-443b-a0fa-0bb81f5218a3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:28.808595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 165/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:28 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:28.814623 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:28.829012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3262-3020-4b08-a30f-cd5bc2dec892 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.829295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3262-3020-4b08-a30f-cd5bc2dec892 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.829602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3262-3020-4b08-a30f-cd5bc2dec892 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.831189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 166/318] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:28.835965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe3d2-165c-4cae-b8da-a63f5f14261d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.836252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe3d2-165c-4cae-b8da-a63f5f14261d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.836530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe3d2-165c-4cae-b8da-a63f5f14261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.855037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6fbbe3d2-165c-4cae-b8da-a63f5f14261d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:28.856304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6fbbe3d2-165c-4cae-b8da-a63f5f14261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:28.904646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:28.931019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 167/319] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:28.936921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd830a7-4fd7-43d3-b09d-8a6cf7b67107 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:28.972705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de374-e483-425e-957d-95624139ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:28.973631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de374-e483-425e-957d-95624139ebcf None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:28.974044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de374-e483-425e-957d-95624139ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:28.974460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de374-e483-425e-957d-95624139ebcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:28.975309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305de374-e483-425e-957d-95624139ebcf None admin] RBAC: Adding query filter params (role.id=c020279e20bc478088b9dee61b83fee6, scope.project.id=1c6f2245555844ccae44339351591ea6, user.id=a33f6f4d73d240a8b4c9ff9bf14d2d61) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:28.975787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305de374-e483-425e-957d-95624139ebcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:28.977340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305de374-e483-425e-957d-95624139ebcf None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:28.991508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 153/320] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:28 2022] GET /identity/v3/role_assignments?user.id=a33f6f4d73d240a8b4c9ff9bf14d2d61&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=c020279e20bc478088b9dee61b83fee6 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:29.212829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe3d2-165c-4cae-b8da-a63f5f14261d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:29.314377 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe3d2-165c-4cae-b8da-a63f5f14261d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:29.348166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bb415-9a00-40fe-afce-1baca70f9a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:29.348806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb415-9a00-40fe-afce-1baca70f9a17 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.349085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb415-9a00-40fe-afce-1baca70f9a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.349355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb415-9a00-40fe-afce-1baca70f9a17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.359806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bb415-9a00-40fe-afce-1baca70f9a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6e5bb415-9a00-40fe-afce-1baca70f9a17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:29.364709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:29.365557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:29.366760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:29.367919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 168/321] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:29.371801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de374-e483-425e-957d-95624139ebcf None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:29.388136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:29.393566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d46ad-5c3d-4546-bdf8-b9ef71402a7c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.393859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d46ad-5c3d-4546-bdf8-b9ef71402a7c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.394149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d46ad-5c3d-4546-bdf8-b9ef71402a7c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.395505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 169/322] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:29.402171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22913231-0094-457d-ae19-bf923b767656 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.402710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22913231-0094-457d-ae19-bf923b767656 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.402984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22913231-0094-457d-ae19-bf923b767656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.423338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-22913231-0094-457d-ae19-bf923b767656 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:29.424708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-22913231-0094-457d-ae19-bf923b767656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:29.455572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:29.483177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de374-e483-425e-957d-95624139ebcf None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:29.496080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 170/323] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:29.496080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e5f4-2a03-4de3-a259-c2b8c6c651b1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.496080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e5f4-2a03-4de3-a259-c2b8c6c651b1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.496080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e5f4-2a03-4de3-a259-c2b8c6c651b1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.496080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 171/324] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:29.504592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e480-c5db-4b64-a83a-547bd2c191f7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.504869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e480-c5db-4b64-a83a-547bd2c191f7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.505132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e480-c5db-4b64-a83a-547bd2c191f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.522012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:29.522619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.522895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.523165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.523260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bb40e480-c5db-4b64-a83a-547bd2c191f7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:29.523855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:29.524218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:29.524407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bb40e480-c5db-4b64-a83a-547bd2c191f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:29.525596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:29.534521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 154/325] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:29.539683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:29.591584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 172/326] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:29.619308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:29.646462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0911a5-a01f-4b86-a159-1b26fe3564ef None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:29.680079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:29.680702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.680981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.681251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] PATH_INFO: `/v3/users/32572f6f30904e4f84205c6c40f1aba9` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.682378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] RBAC: Authorizing `identity:get_user(user_id=32572f6f30904e4f84205c6c40f1aba9)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:29.683857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:29.685617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 155/327] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:29 2022] GET /identity/v3/users/32572f6f30904e4f84205c6c40f1aba9 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:29.691941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e480-c5db-4b64-a83a-547bd2c191f7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:29.763460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:29.787745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:29.792000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e480-c5db-4b64-a83a-547bd2c191f7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:29.829274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:29.829893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.830169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.830433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.831148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] RBAC: Adding query filter params (role.id=08098571657746a1bfa166c6cc1dd6a6, user.id=32572f6f30904e4f84205c6c40f1aba9, scope.system=all) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:29.831479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:29.832893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:29.844570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 173/328] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Sep 6 04:09:29 2022] GET /identity/v3/role_assignments?user.id=32572f6f30904e4f84205c6c40f1aba9&scope.system=all&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:29.865726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:29.876338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016e74-f1c5-4456-8086-2214542539f5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:29.916850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:29.917792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:29.918069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:29.918338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:29.920207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:29.921714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:29.923957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 156/329] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:29.929542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:29.942912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:29.979660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139a9b-968a-409f-852e-6fdf209a6782 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:30.024770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:30.025395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:30.025746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:30.026043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:30.037233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:30.043171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:30.044130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:30.044921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 174/330] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:30.048002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe918b-b3c1-4380-8d1e-0f5e30b10a2b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:30.050655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:30.068316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:30.082481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:30.083084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:30.083362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:30.083663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] PATH_INFO: `/v3/groups` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:30.084289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:30.085727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:30.101355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 157/331] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Sep 6 04:09:29 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:09:30.161878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a3b27-9da1-4f07-a14d-31a99471c4f9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:30.197340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:30.197957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:30.198229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:30.198495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:30.199163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:30.199510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:30.200896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:30.209761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 175/332] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:30.215507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:30.289556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:30.322069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048543-c93f-445b-9a10-1f0f063e7c4b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:30.358115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf111956-8dca-4e55-af63-75e9f3db079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:30.358752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf111956-8dca-4e55-af63-75e9f3db079d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:30.359033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf111956-8dca-4e55-af63-75e9f3db079d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:30.359297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf111956-8dca-4e55-af63-75e9f3db079d None admin] PATH_INFO: `/v3/users/b2862aaa884448efbdceb6af16231385` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:30.361677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf111956-8dca-4e55-af63-75e9f3db079d None admin] RBAC: Authorizing `identity:get_user(user_id=b2862aaa884448efbdceb6af16231385)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:30.363880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf111956-8dca-4e55-af63-75e9f3db079d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:30.365518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 158/333] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:30 2022] GET /identity/v3/users/b2862aaa884448efbdceb6af16231385 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:30.371198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:30.457491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:30.481734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15402607-d28a-4dcb-b29e-1549477a13a8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:30.519961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bd7d8-0921-43fa-aaab-86622f596be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:30.520611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bd7d8-0921-43fa-aaab-86622f596be0 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:30.520886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bd7d8-0921-43fa-aaab-86622f596be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:30.521158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bd7d8-0921-43fa-aaab-86622f596be0 None admin] PATH_INFO: `/v3/system/users/b2862aaa884448efbdceb6af16231385/roles/c020279e20bc478088b9dee61b83fee6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:30.522581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bd7d8-0921-43fa-aaab-86622f596be0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b2862aaa884448efbdceb6af16231385, role_id=c020279e20bc478088b9dee61b83fee6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:30.524005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bd7d8-0921-43fa-aaab-86622f596be0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:30.534420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 176/334] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Sep 6 04:09:30 2022] PUT /identity/v3/system/users/b2862aaa884448efbdceb6af16231385/roles/c020279e20bc478088b9dee61b83fee6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:32.326362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037fbe1-4ece-4392-b86e-55e013151608 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:32.326859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037fbe1-4ece-4392-b86e-55e013151608 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:32.326859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037fbe1-4ece-4392-b86e-55e013151608 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:32.328323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 159/335] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:32.344008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ab63-4143-4e8d-9aee-19f996a7aa20 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:32.344935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ab63-4143-4e8d-9aee-19f996a7aa20 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:32.345443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ab63-4143-4e8d-9aee-19f996a7aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:32.372514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f426ab63-4143-4e8d-9aee-19f996a7aa20 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:32.373922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5b7f-50c6-4bbf-87e4-60a5f1b94519 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:32.374054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f426ab63-4143-4e8d-9aee-19f996a7aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:32.374560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5b7f-50c6-4bbf-87e4-60a5f1b94519 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:32.375034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5b7f-50c6-4bbf-87e4-60a5f1b94519 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:32.379162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 160/336] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:32.384800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecbe9-eeb7-4c38-a167-8692f08097c3 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:32.385536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecbe9-eeb7-4c38-a167-8692f08097c3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:32.386332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecbe9-eeb7-4c38-a167-8692f08097c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:32.424442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d33ecbe9-eeb7-4c38-a167-8692f08097c3 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:32.425987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d33ecbe9-eeb7-4c38-a167-8692f08097c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:32.465935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 177/337] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:32.549868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 161/338] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:32.927974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ab63-4143-4e8d-9aee-19f996a7aa20 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:33.012285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f134-3747-4ce0-92f8-46405466d76c None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.012906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f134-3747-4ce0-92f8-46405466d76c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.013602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f134-3747-4ce0-92f8-46405466d76c None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.015825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 162/339] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:33.020545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8df14-fa72-4e89-9385-99929cd3c5af None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.021244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8df14-fa72-4e89-9385-99929cd3c5af None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.021712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8df14-fa72-4e89-9385-99929cd3c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.026584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:33.060434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7bd8df14-fa72-4e89-9385-99929cd3c5af None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:33.061996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7bd8df14-fa72-4e89-9385-99929cd3c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:33.072175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ab63-4143-4e8d-9aee-19f996a7aa20 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:33.106002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:33.106908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.107327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.107782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.120860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:33.126031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:33.127129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:33.127935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:33.129984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 178/340] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:33.131265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:33.176902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:33.183740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 163/341] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:33.185644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c925a-c17f-4956-8bad-8d7d8da26e38 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.186128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c925a-c17f-4956-8bad-8d7d8da26e38 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.186610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c925a-c17f-4956-8bad-8d7d8da26e38 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.188416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 164/342] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:33.189944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c925a-c17f-4956-8bad-8d7d8da26e38 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:33.234901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2e30-da1b-42c0-a46d-9405f528e36e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:33.267945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:33.273575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461fff5-23b0-4386-9786-0b863da1ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:33.275661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461fff5-23b0-4386-9786-0b863da1ac7f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.275661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461fff5-23b0-4386-9786-0b863da1ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.275661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461fff5-23b0-4386-9786-0b863da1ac7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.286489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461fff5-23b0-4386-9786-0b863da1ac7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7461fff5-23b0-4386-9786-0b863da1ac7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:33.291859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:33.292931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:33.293906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:33.296060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 179/343] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:33.297625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e66a5-65ba-4731-b3d3-21974e034347 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.298180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e66a5-65ba-4731-b3d3-21974e034347 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.298728 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e66a5-65ba-4731-b3d3-21974e034347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.322380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-138e66a5-65ba-4731-b3d3-21974e034347 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:33.323970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-138e66a5-65ba-4731-b3d3-21974e034347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:33.401112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 180/344] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:33.402717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e66a5-65ba-4731-b3d3-21974e034347 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:33.432097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c925a-c17f-4956-8bad-8d7d8da26e38 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:33.482487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:33.483532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.484104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.484501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.485536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:33.485967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:33.487784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:33.509871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 165/345] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:33.520569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:33.562358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e66a5-65ba-4731-b3d3-21974e034347 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:33.590940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:33.607424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:33.647771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853080fa-b06d-4c03-abb4-10ea355979eb None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:33.653412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:33.654477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.654978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.655489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.656618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:33.656956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:33.658410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:33.678082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 181/346] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:33.679056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:33.685989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:33.686775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.687102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.687388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.765375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:33.766848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:33.828847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:33.882830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 166/347] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:33.883579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:33.894546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f999be-0521-4cbc-96a5-61b36e1a9992 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:33.968476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:33.969341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:33.969620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:33.969890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:33.992960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:34.009393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:34.010429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 04:09:34.011222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:34.012337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 182/348] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:34.012441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5fa6-47de-4708-884c-1bdf60106f7b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.012793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.056173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.056737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.057014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.057281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.090550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.098350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.135887 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.137347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.161638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319474f-72ba-43f8-8644-115a4f59c8b9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.200503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.201571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.202096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.202563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.203971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.205793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.208091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 183/349] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:34.209083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.246146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 167/350] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:34.247361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.324220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.341400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb946c2-1263-42f5-bb5f-618219b0a4ad None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.358644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.379945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ffba-1cf2-49bf-a21d-dee41d45e8e0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.388662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.389626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.390097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.390557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.391437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:34.392517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.394503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.404013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 184/351] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:34.404845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.421365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9a3bb-488b-425a-a3ad-0c618fcb7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.422250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9a3bb-488b-425a-a3ad-0c618fcb7e4d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.422670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9a3bb-488b-425a-a3ad-0c618fcb7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.423081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9a3bb-488b-425a-a3ad-0c618fcb7e4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.434710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9a3bb-488b-425a-a3ad-0c618fcb7e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-83c9a3bb-488b-425a-a3ad-0c618fcb7e4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:34.442151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:34.443050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:34.443867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:34.446132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 168/352] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:34.447571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7cb5-7547-4d6b-9c02-ed3d5a20e3fd None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.448072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7cb5-7547-4d6b-9c02-ed3d5a20e3fd None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.448549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7cb5-7547-4d6b-9c02-ed3d5a20e3fd None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.450027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 169/353] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:34.450644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d7cb5-7547-4d6b-9c02-ed3d5a20e3fd None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.542951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c355807-4f75-4f01-b315-589ca1a79301 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.588362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.589310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.589863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.590223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.599392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.601132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.601240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d7cb5-7547-4d6b-9c02-ed3d5a20e3fd None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.603883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 185/354] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:34.604855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.633399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.653871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22941358-9107-44d6-97cd-a48ffb757fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.655877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941358-9107-44d6-97cd-a48ffb757fce None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.655877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941358-9107-44d6-97cd-a48ffb757fce None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.655877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941358-9107-44d6-97cd-a48ffb757fce None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.656474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22941358-9107-44d6-97cd-a48ffb757fce None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.658471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22941358-9107-44d6-97cd-a48ffb757fce None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.660146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 170/355] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:34.661527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53339c51-1aae-4597-a346-3ce96b3d4ca2 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.662030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53339c51-1aae-4597-a346-3ce96b3d4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.662493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53339c51-1aae-4597-a346-3ce96b3d4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.663834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.683614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-53339c51-1aae-4597-a346-3ce96b3d4ca2 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:34.685283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-53339c51-1aae-4597-a346-3ce96b3d4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:34.737094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e08f3-6b05-4a06-9939-029adc423fe3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.761038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 171/356] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:34.762299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53339c51-1aae-4597-a346-3ce96b3d4ca2 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.776682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.778401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.778401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.778401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] PATH_INFO: `/v3/users/b2862aaa884448efbdceb6af16231385` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.779071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] RBAC: Authorizing `identity:get_user(user_id=b2862aaa884448efbdceb6af16231385)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.782257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.788689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 186/357] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/users/b2862aaa884448efbdceb6af16231385 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:34.788689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.908815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53339c51-1aae-4597-a346-3ce96b3d4ca2 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.910047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a32e7-5b7e-4259-ba2f-d8b4629d3197 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:34.918821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.934008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:34.954612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.955973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.956247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.956515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.957242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=020e792f68e2488e84a2d16ea12d0c27) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:34.957547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.958971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.962353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287ab57-4f96-4276-848e-991385e34460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:34.962948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ab57-4f96-4276-848e-991385e34460 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.963223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ab57-4f96-4276-848e-991385e34460 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.963529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ab57-4f96-4276-848e-991385e34460 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.964183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ab57-4f96-4276-848e-991385e34460 None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:34.964480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ab57-4f96-4276-848e-991385e34460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:34.965840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ab57-4f96-4276-848e-991385e34460 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:34.966732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 187/358] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:34.967362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:34.975013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 172/359] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:34.976602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99bd2-5568-4c40-ad43-afdc1e8f5b8a None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:34.976999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99bd2-5568-4c40-ad43-afdc1e8f5b8a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:34.977370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99bd2-5568-4c40-ad43-afdc1e8f5b8a None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:34.983326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 173/360] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:34.984362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99bd2-5568-4c40-ad43-afdc1e8f5b8a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.116590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99167f-3d54-4470-917b-abf4b4ef4541 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.140341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99bd2-5568-4c40-ad43-afdc1e8f5b8a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.163573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.164647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.164929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.165200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.167229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:35.168687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:35.170654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 188/361] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:35.171491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.179286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b65e8a-5a09-4127-838d-6db5219d4f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.179928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65e8a-5a09-4127-838d-6db5219d4f05 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.180204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65e8a-5a09-4127-838d-6db5219d4f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.180476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65e8a-5a09-4127-838d-6db5219d4f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.181208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b65e8a-5a09-4127-838d-6db5219d4f05 None admin] RBAC: Adding query filter params (role.id=c020279e20bc478088b9dee61b83fee6, user.id=b2862aaa884448efbdceb6af16231385, scope.system=all) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:35.181508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b65e8a-5a09-4127-838d-6db5219d4f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:35.183094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b65e8a-5a09-4127-838d-6db5219d4f05 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:35.197948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 174/362] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Sep 6 04:09:34 2022] GET /identity/v3/role_assignments?user.id=b2862aaa884448efbdceb6af16231385&scope.system=all&role.id=c020279e20bc478088b9dee61b83fee6 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:35.199191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5028-333d-4924-be0f-c26295f814d3 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.199501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5028-333d-4924-be0f-c26295f814d3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.199776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5028-333d-4924-be0f-c26295f814d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.225965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b67a5028-333d-4924-be0f-c26295f814d3 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:35.227631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b67a5028-333d-4924-be0f-c26295f814d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:35.231057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:35.290115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:35.327714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b663f-aa3b-430b-ae7b-debca54b20d4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.352992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 175/363] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:35.354399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a5028-333d-4924-be0f-c26295f814d3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.370888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.371545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.371819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.372086 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.455337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:35.456851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:35.489501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a5028-333d-4924-be0f-c26295f814d3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.510640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:35.547051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.547730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.548012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.548845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.564179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:35.571198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:35.572089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:35.572884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 176/364] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:35.574160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.590565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 189/365] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:35.592605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.620463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:35.708532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21087-4d07-4e7b-ac9c-08386dbc3a7a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.713888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2da3d-1515-4386-b4b6-e545e397bff3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.751084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.751553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.751817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.752096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.752193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.752367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.752462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.752635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.753034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:35.753335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:35.753427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=020e792f68e2488e84a2d16ea12d0c27) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:35.753652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:35.754715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:35.755081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:35.763710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 177/366] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:35.764422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.764800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:35.769496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 190/367] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:35.770337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.900708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a248-6082-42db-a00c-ac8f9e78eace None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.905710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:35.921350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe121-613a-4260-9749-44a42d1282a4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:35.951299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.952362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.953114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.953581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.965652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:35.966825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:35.967186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:35.967561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:35.968042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:35.969373 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:35.971619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:35.973188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:35.974055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:35.974838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 191/368] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:35.975506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:35.976730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 178/369] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:35.979898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:36.060452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:36.110656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b2a22-5f10-466d-89fd-fefb94355f98 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:36.123213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d9bd1-f4ac-451c-9df6-c0809fa2a069 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:36.147776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:36.148391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:36.148671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:36.148943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:36.162864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:36.163809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:36.164357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:36.164839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:36.165675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:36.166153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:36.167970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:36.178560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 179/370] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:36.179912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:36.209335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:36.246129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:36.248000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:36.320565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8574-deff-405b-8f62-4d60cf416998 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:36.338680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:36.374994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:36.376265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:36.377279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:36.378157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:36.380096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:36.382646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:36.385559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 180/371] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:36 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:36.386612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:36.401763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 192/372] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:36.404834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:36.532148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:36.542952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521191-8b22-4aad-a3df-667020cb09b3 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:36.559935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379cf5-b2c4-49f5-b89d-7b9f3188cae4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:36.593252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:36.593859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:36.594135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:36.594403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:36.608468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:36.609074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:36.609344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:36.609609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:36.610334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=1c6f2245555844ccae44339351591ea6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:36.610636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:36.615052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:36.623265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 193/373] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:36 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:36.624142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:36.655146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:36.746848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c7c08-86ba-4373-8cbf-4b56a09d342d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:36.764565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:36.766451 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:36.788132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:36.788879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:36.789065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:36.789327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:36.790499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:36.792007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:36.794251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 194/374] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:36 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:36.801757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:36.913125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:36.927283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 181/375] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:36.932936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:37.018206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:37.028630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4502bf-e4c0-4eaa-91f0-e7c4fac35592 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:37.079342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:37.080157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:37.080435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:37.080706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:37.084159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:37.085614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:37.089669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 195/376] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:36 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:37.094114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:37.152425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f287c7-e3d9-4e5d-a1ee-c0f989b3067c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:37.239281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a48de-f9be-4d3c-b1dc-d2550b5ebfae None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:37.247158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6827b-4865-473f-9047-b6f21306dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:37.247830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6827b-4865-473f-9047-b6f21306dd16 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:37.248106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6827b-4865-473f-9047-b6f21306dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:37.248379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6827b-4865-473f-9047-b6f21306dd16 None admin] PATH_INFO: `/v3/projects/e7e04b96ebc74904845e65316dbf81fa` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:37.249588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6827b-4865-473f-9047-b6f21306dd16 None admin] RBAC: Authorizing `identity:get_project(project_id=e7e04b96ebc74904845e65316dbf81fa)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:37.251044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6827b-4865-473f-9047-b6f21306dd16 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:37.253665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 182/377] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:36 2022] GET /identity/v3/projects/e7e04b96ebc74904845e65316dbf81fa => generated 344 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:37.254840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea29e2-a404-4699-8892-dcba5d8db346 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:37.255120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea29e2-a404-4699-8892-dcba5d8db346 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:37.255408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea29e2-a404-4699-8892-dcba5d8db346 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:37.260988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 183/378] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:37.261691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea29e2-a404-4699-8892-dcba5d8db346 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:37.278541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcda9d-6a03-4bb2-8bb1-07c056ad9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:37.279153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcda9d-6a03-4bb2-8bb1-07c056ad9348 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:37.279480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcda9d-6a03-4bb2-8bb1-07c056ad9348 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:37.280130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcda9d-6a03-4bb2-8bb1-07c056ad9348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:37.281141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcda9d-6a03-4bb2-8bb1-07c056ad9348 None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=1c6f2245555844ccae44339351591ea6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:37.281447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcda9d-6a03-4bb2-8bb1-07c056ad9348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:37.283650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcda9d-6a03-4bb2-8bb1-07c056ad9348 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:37.290882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 196/379] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:37 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:37.292108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06801-ddb3-4102-96d4-45350af5db06 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:37.292386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06801-ddb3-4102-96d4-45350af5db06 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:37.292652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06801-ddb3-4102-96d4-45350af5db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:37.315009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-44f06801-ddb3-4102-96d4-45350af5db06 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:37.319044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-44f06801-ddb3-4102-96d4-45350af5db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:37.341773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:37.382383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:37.407437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 197/380] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:37.467108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea29e2-a404-4699-8892-dcba5d8db346 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:37.511158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:37.511883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:37.512226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:37.512549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] PATH_INFO: `/v3/groups/c4325e72950f41aba185f1ba92b671a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:37.519234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] RBAC: Authorizing `identity:get_group(group_id=c4325e72950f41aba185f1ba92b671a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:37.520725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:37.522643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 184/381] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:37 2022] GET /identity/v3/groups/c4325e72950f41aba185f1ba92b671a6 => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:37.528278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06801-ddb3-4102-96d4-45350af5db06 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:37.642073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06801-ddb3-4102-96d4-45350af5db06 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:37.684959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:37.685825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:37.686241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:37.686649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:37.687545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] RBAC: Adding query filter params (group.id=c4325e72950f41aba185f1ba92b671a6, role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=e7e04b96ebc74904845e65316dbf81fa) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:37.688004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:37.689611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:37.699940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 198/382] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:37 2022] GET /identity/v3/role_assignments?group.id=c4325e72950f41aba185f1ba92b671a6&scope.project.id=e7e04b96ebc74904845e65316dbf81fa&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:37.823679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:37.957086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3af528-508b-44ab-99b4-8b2a01b483d0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:37.982608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:38.004740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b327f-a700-4933-9f6a-1fa081d42b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:38.005546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b327f-a700-4933-9f6a-1fa081d42b26 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:38.006227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b327f-a700-4933-9f6a-1fa081d42b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:38.006630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b327f-a700-4933-9f6a-1fa081d42b26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:38.018487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b327f-a700-4933-9f6a-1fa081d42b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-cb8b327f-a700-4933-9f6a-1fa081d42b26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:38.024017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:38.025088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:38.026081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:38.028402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 185/383] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:38.036481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:38.078701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:38.167568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049d995-7ed2-4008-b29d-f0c95580e7d2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:38.189681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aa336-3456-4320-8e0f-c60cb5ea5c8f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:38.189977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aa336-3456-4320-8e0f-c60cb5ea5c8f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:38.190240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aa336-3456-4320-8e0f-c60cb5ea5c8f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:38.196063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 186/384] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:38.200710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36a7d-317a-41c0-8fef-0af16634ed24 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:38.200993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36a7d-317a-41c0-8fef-0af16634ed24 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:38.201267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36a7d-317a-41c0-8fef-0af16634ed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:38.218169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6930-793d-4830-a247-cde18743e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:38.218709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6930-793d-4830-a247-cde18743e33a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:38.218987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6930-793d-4830-a247-cde18743e33a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:38.219255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6930-793d-4830-a247-cde18743e33a None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:38.220068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6930-793d-4830-a247-cde18743e33a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:38.220411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6930-793d-4830-a247-cde18743e33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:38.221797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6930-793d-4830-a247-cde18743e33a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:38.233414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 199/385] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:38.238200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7ce36a7d-317a-41c0-8fef-0af16634ed24 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:38.239507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7ce36a7d-317a-41c0-8fef-0af16634ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:38.239804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6930-793d-4830-a247-cde18743e33a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:38.355605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:38.366083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 187/386] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:38.387859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6930-793d-4830-a247-cde18743e33a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:38.426490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:38.427519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:38.427801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:38.428074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:38.429358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:38.430981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:38.433573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 200/387] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:38 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:38.444645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce36a7d-317a-41c0-8fef-0af16634ed24 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:38.590827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce36a7d-317a-41c0-8fef-0af16634ed24 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:38.613911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:38.640324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:38.640968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:38.641248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:38.641521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:38.643180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:38.644685 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:38.646687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 188/388] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:38 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:38.652015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:38.796516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7488-5487-40be-8553-4a781d631660 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:38.846950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:38.847552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:38.847831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:38.848100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27/groups/5b323bf382524c9d8e30801afd5c7180/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:38.853127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=020e792f68e2488e84a2d16ea12d0c27, group_id=5b323bf382524c9d8e30801afd5c7180, role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:38.854565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:38.856091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:38.881857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 201/389] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Sep 6 04:09:38 2022] PUT /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27/groups/5b323bf382524c9d8e30801afd5c7180/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:39.026552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95faa-70f4-4292-a4a9-c8271ebf0417 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:39.070869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e57329-1725-4cd1-a902-4089aabaae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:39.071533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57329-1725-4cd1-a902-4089aabaae7e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.071813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57329-1725-4cd1-a902-4089aabaae7e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.072088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57329-1725-4cd1-a902-4089aabaae7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.083696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e57329-1725-4cd1-a902-4089aabaae7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-f1e57329-1725-4cd1-a902-4089aabaae7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:39.089988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:39.090933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:39.091853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 189/390] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:39.097251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:39.113368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:39.170683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e8b47-d4d2-4e70-992c-31743eca3d0f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.171012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e8b47-d4d2-4e70-992c-31743eca3d0f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.171217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e8b47-d4d2-4e70-992c-31743eca3d0f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.172586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 190/391] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:39.185363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30558ab-469c-4294-97c0-7a91c65411a9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.185363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30558ab-469c-4294-97c0-7a91c65411a9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.185363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30558ab-469c-4294-97c0-7a91c65411a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.213862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c30558ab-469c-4294-97c0-7a91c65411a9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:39.215079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c30558ab-469c-4294-97c0-7a91c65411a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:39.241528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3ef1-b8aa-4371-ac1d-7426bbd2f8c4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:39.264407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:39.308462 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:39.309129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.309381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.309652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.310347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:39.310651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:39.312116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:39.323027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 191/392] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:39.334864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 202/393] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:39.336217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30558ab-469c-4294-97c0-7a91c65411a9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:39.455308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30558ab-469c-4294-97c0-7a91c65411a9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:39.505662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:39.506620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.506897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.507156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.508300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:39.509749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:39.516268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 192/394] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:39 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:39.517165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:39.595262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:39.626233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bda32-e155-46e8-b54d-3f7a2dba970e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:39.666918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:39.667594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.667882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.668147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.669257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:39.670822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:39.672351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:39.672760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 203/395] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:39 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:39.680273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:39.715825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:39.779531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2916-1f47-49b2-8616-da9226c78985 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:39.823531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ed4aa-0e99-4b43-be3b-8561c2c408df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:39.824164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed4aa-0e99-4b43-be3b-8561c2c408df None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.824438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed4aa-0e99-4b43-be3b-8561c2c408df None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.824703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed4aa-0e99-4b43-be3b-8561c2c408df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.842877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ed4aa-0e99-4b43-be3b-8561c2c408df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:39.846784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e76cb-9c06-4171-9af5-321ae56a24ad None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-6e5ed4aa-0e99-4b43-be3b-8561c2c408df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:39.852230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:39.853137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:39.853996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 193/396] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:39.855142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96055c-e960-47a7-92b6-4496023e41c5 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.855359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96055c-e960-47a7-92b6-4496023e41c5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.855656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96055c-e960-47a7-92b6-4496023e41c5 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.857132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 194/397] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:39.858985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96055c-e960-47a7-92b6-4496023e41c5 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:39.892817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a5453-371e-43a9-860e-c5086c379023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:39.893814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a5453-371e-43a9-860e-c5086c379023 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.894298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a5453-371e-43a9-860e-c5086c379023 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.894795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a5453-371e-43a9-860e-c5086c379023 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27/groups/5b323bf382524c9d8e30801afd5c7180/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.897325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a5453-371e-43a9-860e-c5086c379023 None admin] RBAC: Authorizing `identity:create_grant(project_id=020e792f68e2488e84a2d16ea12d0c27, group_id=5b323bf382524c9d8e30801afd5c7180, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:39.898967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a5453-371e-43a9-860e-c5086c379023 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:39.915708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:39.918783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 204/398] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Sep 6 04:09:39 2022] PUT /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27/groups/5b323bf382524c9d8e30801afd5c7180/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:09:39.921235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692ffe-8911-4865-b29d-542457821e55 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:39.922290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692ffe-8911-4865-b29d-542457821e55 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:39.922780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692ffe-8911-4865-b29d-542457821e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:39.948765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b7692ffe-8911-4865-b29d-542457821e55 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:39.951671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b7692ffe-8911-4865-b29d-542457821e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:39.995468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:40.002219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96055c-e960-47a7-92b6-4496023e41c5 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:40.045467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:40.046088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.046367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.046646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.047325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:40.047690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:40.049937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:40.060180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 195/399] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:40.071910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:40.123992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 205/400] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:40.211179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231310b2-6b6b-4bbc-8772-5b4f8c848c44 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:40.249299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:40.249850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.250127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.250398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.251601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:40.253110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:40.255158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 196/401] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:40 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:40.264450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692ffe-8911-4865-b29d-542457821e55 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:40.409103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692ffe-8911-4865-b29d-542457821e55 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:40.450134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:40.456755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:40.461873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:40.462511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.462790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.463064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.468230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:40.469539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:40.471975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 206/402] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:40 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:40.477495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:40.499879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:40.585274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f585-85d2-4841-a318-402845b2f09d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:40.604826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb603dc5-0fc6-45f3-a5da-670089de2d9e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:40.620612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164a25-428b-4c11-86f4-6702f545a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:40.621356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164a25-428b-4c11-86f4-6702f545a588 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.621650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164a25-428b-4c11-86f4-6702f545a588 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.621875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164a25-428b-4c11-86f4-6702f545a588 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6/groups/5b323bf382524c9d8e30801afd5c7180/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.623804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2164a25-428b-4c11-86f4-6702f545a588 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c6f2245555844ccae44339351591ea6, group_id=5b323bf382524c9d8e30801afd5c7180, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:40.625303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2164a25-428b-4c11-86f4-6702f545a588 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:40.642741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 207/403] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Sep 6 04:09:40 2022] PUT /identity/v3/projects/1c6f2245555844ccae44339351591ea6/groups/5b323bf382524c9d8e30801afd5c7180/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:40.649471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:40.650408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b288aa-2f7c-43c4-8104-b86cce45cd50 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.650639 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.650771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b288aa-2f7c-43c4-8104-b86cce45cd50 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.650958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b288aa-2f7c-43c4-8104-b86cce45cd50 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.651515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.651993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.652732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 208/404] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:40.658970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ddd1-4cf5-4c06-bd28-f8afce47b60d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.659315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ddd1-4cf5-4c06-bd28-f8afce47b60d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.659644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ddd1-4cf5-4c06-bd28-f8afce47b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.665519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:40.671521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:40.672494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:40.673337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:40.676076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 197/405] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:40.681964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:40.696656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-30e6ddd1-4cf5-4c06-bd28-f8afce47b60d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:40.697880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-30e6ddd1-4cf5-4c06-bd28-f8afce47b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:40.799870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:40.820243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:40.833215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460fa78-e471-4ca1-830b-020625169d99 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:40.860673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 209/406] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:40.881900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:40.883186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:40.883712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:40.884197 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:40.885064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:40.885577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:40.887146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:40.896989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 198/407] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:40.902765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6ddd1-4cf5-4c06-bd28-f8afce47b60d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:41.008008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6ddd1-4cf5-4c06-bd28-f8afce47b60d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:41.051214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:41.051792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.052068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.052336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.056083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:41.057600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:41.059460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 210/408] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:40 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:41.065420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:41.180502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:41.190702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8355f1-d642-4c36-9d2e-691775a46ffe None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:41.242842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:41.243569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.243848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.244119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.245301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:41.246797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:41.249039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 199/409] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:41 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:41.255166 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:41.264033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:41.277115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:41.348459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c014-8b3f-478e-936c-f23fd261c6f2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:41.363151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858638c-5a7f-4724-b982-8433821eb425 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:41.386127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0def5-8668-46df-859b-67f5197abf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:41.386752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0def5-8668-46df-859b-67f5197abf58 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.387114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0def5-8668-46df-859b-67f5197abf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.387407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0def5-8668-46df-859b-67f5197abf58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.398244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0def5-8668-46df-859b-67f5197abf58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:41.398585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10715f7-c41d-468f-b5d7-5ef701094cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:41.399248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10715f7-c41d-468f-b5d7-5ef701094cfc None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.399619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10715f7-c41d-468f-b5d7-5ef701094cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.399940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10715f7-c41d-468f-b5d7-5ef701094cfc None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6/groups/5b323bf382524c9d8e30801afd5c7180/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.402111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10715f7-c41d-468f-b5d7-5ef701094cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=1c6f2245555844ccae44339351591ea6, group_id=5b323bf382524c9d8e30801afd5c7180, role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:41.403590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10715f7-c41d-468f-b5d7-5ef701094cfc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e2a0def5-8668-46df-859b-67f5197abf58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:41.403712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:41.404566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:41.405361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 211/410] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:41.410593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799d64-7e7a-43f0-aa62-389ee05058b4 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.410871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799d64-7e7a-43f0-aa62-389ee05058b4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.411141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799d64-7e7a-43f0-aa62-389ee05058b4 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.412519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 212/411] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:41.416306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799d64-7e7a-43f0-aa62-389ee05058b4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:41.422330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 200/412] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Sep 6 04:09:41 2022] PUT /identity/v3/projects/1c6f2245555844ccae44339351591ea6/groups/5b323bf382524c9d8e30801afd5c7180/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:09:41.429890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed482bda-cb29-4386-ba29-3b48a7d5fcfb None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.430198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed482bda-cb29-4386-ba29-3b48a7d5fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.430424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed482bda-cb29-4386-ba29-3b48a7d5fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.458353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-ed482bda-cb29-4386-ba29-3b48a7d5fcfb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:41.466142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ed482bda-cb29-4386-ba29-3b48a7d5fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:41.599701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 201/413] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:41.612595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799d64-7e7a-43f0-aa62-389ee05058b4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:41.627780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:41.649632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:41.650240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.650518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.650791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.651480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:41.651785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:41.653270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:41.662387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 213/414] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:41.667992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed482bda-cb29-4386-ba29-3b48a7d5fcfb None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:41.679930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:41.789225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed482bda-cb29-4386-ba29-3b48a7d5fcfb None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:41.824519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:41.825164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:41.825441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:41.825714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] PATH_INFO: `/v3/groups/c4325e72950f41aba185f1ba92b671a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:41.826838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] RBAC: Authorizing `identity:get_group(group_id=c4325e72950f41aba185f1ba92b671a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:41.828337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:41.830252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 202/415] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:41 2022] GET /identity/v3/groups/c4325e72950f41aba185f1ba92b671a6 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:41.835815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:41.943731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:42.003437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91dd34-9b7b-4c2b-a8b1-7231ebec633b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:42.052907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:42.072127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:42.072775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:42.073050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:42.073317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] PATH_INFO: `/v3/projects/e7e04b96ebc74904845e65316dbf81fa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:42.074481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] RBAC: Authorizing `identity:get_project(project_id=e7e04b96ebc74904845e65316dbf81fa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:42.074590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbeacf-71c2-471e-bc36-c77a78870b82 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:42.075947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:42.077866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 214/416] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:41 2022] GET /identity/v3/projects/e7e04b96ebc74904845e65316dbf81fa => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:42.083882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:42.112259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:42.113252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:42.113538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:42.113808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:42.130861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:42.139210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:42.140135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:42.142769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 203/417] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:42.149251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:42.203813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:42.311399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef121ac-b336-43d8-b623-d45f8c8bf95f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:42.343082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47336fe-ab07-4043-8fc5-6f48bcdea7c7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:42.357685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de103537-933b-44fd-b5a4-d8319d6168c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:42.358349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103537-933b-44fd-b5a4-d8319d6168c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:42.358626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103537-933b-44fd-b5a4-d8319d6168c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:42.359030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103537-933b-44fd-b5a4-d8319d6168c1 None admin] PATH_INFO: `/v3/projects/e7e04b96ebc74904845e65316dbf81fa/groups/c4325e72950f41aba185f1ba92b671a6/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:42.361706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de103537-933b-44fd-b5a4-d8319d6168c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7e04b96ebc74904845e65316dbf81fa, group_id=c4325e72950f41aba185f1ba92b671a6, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:42.363632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de103537-933b-44fd-b5a4-d8319d6168c1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:42.380915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 215/418] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Sep 6 04:09:42 2022] PUT /identity/v3/projects/e7e04b96ebc74904845e65316dbf81fa/groups/c4325e72950f41aba185f1ba92b671a6/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:09:42.382411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd92d10-4ac6-475d-b015-287b74ff5b58 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:42.382751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd92d10-4ac6-475d-b015-287b74ff5b58 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:42.383027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd92d10-4ac6-475d-b015-287b74ff5b58 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:42.384615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 216/419] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:42.386319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:42.386990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:42.387270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:42.387588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:42.388262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:42.388564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:42.395487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52199d9-4907-446a-947f-fee38be682c2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:42.395888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:42.396365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52199d9-4907-446a-947f-fee38be682c2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:42.396851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52199d9-4907-446a-947f-fee38be682c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:42.405218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:42.420146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 204/420] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:42.421703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:42.425425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a52199d9-4907-446a-947f-fee38be682c2 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:42.427250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a52199d9-4907-446a-947f-fee38be682c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:42.561006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 217/421] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:42.617068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da1476-1e13-408e-8ca5-61bd17b2fb78 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:42.653077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:42.653684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:42.653964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:42.654240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:42.727266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:42.728014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:42.729637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:42.833683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 205/422] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:42.844663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52199d9-4907-446a-947f-fee38be682c2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:42.866635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:42.902067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:42.997591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:43.001269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e6fae-51a7-48e2-afbb-4bce6bcd6698 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:43.037303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:43.037963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.038243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.038513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.041488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52199d9-4907-446a-947f-fee38be682c2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:43.049733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:43.054725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:43.055643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:43.056441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 206/423] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:43.063171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:43.104633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:43.105182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.105453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.105721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.107704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:43.109146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:43.111266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 218/424] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:42 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:43.117288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:43.199601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefbc96-4400-4bbb-8fd2-fc2b3daa92ec None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:43.234870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6b3ec-8079-4704-8c94-b58933f0409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:43.236548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6b3ec-8079-4704-8c94-b58933f0409a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.237080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6b3ec-8079-4704-8c94-b58933f0409a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.237355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6b3ec-8079-4704-8c94-b58933f0409a None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.238020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6b3ec-8079-4704-8c94-b58933f0409a None admin] RBAC: Adding query filter params (name=member) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:43.238320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6b3ec-8079-4704-8c94-b58933f0409a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:43.239096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d129e-72ff-4c72-b57f-f6fe0cc23ff4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:43.239730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6b3ec-8079-4704-8c94-b58933f0409a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:43.241073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:43.253559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 207/425] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:43.255014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492e5b-83b0-4504-910a-5df49a520ad7 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.255484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492e5b-83b0-4504-910a-5df49a520ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.255892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492e5b-83b0-4504-910a-5df49a520ad7 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.257735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 208/426] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:43.258859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03492e5b-83b0-4504-910a-5df49a520ad7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:43.287945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:43.289242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1daf1-3e15-48e7-9712-30d99d447276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:43.289654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1daf1-3e15-48e7-9712-30d99d447276 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.289938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1daf1-3e15-48e7-9712-30d99d447276 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.290219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1daf1-3e15-48e7-9712-30d99d447276 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.291566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1daf1-3e15-48e7-9712-30d99d447276 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:43.293001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1daf1-3e15-48e7-9712-30d99d447276 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:43.299838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 219/427] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:43 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:43.301133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebe4f-7f44-4995-aa88-9ef66ad72744 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.301503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebe4f-7f44-4995-aa88-9ef66ad72744 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.301792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebe4f-7f44-4995-aa88-9ef66ad72744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.320810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-092ebe4f-7f44-4995-aa88-9ef66ad72744 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:43.322079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-092ebe4f-7f44-4995-aa88-9ef66ad72744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:43.388027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03492e5b-83b0-4504-910a-5df49a520ad7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:43.405588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 220/428] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:43.406961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebe4f-7f44-4995-aa88-9ef66ad72744 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:43.456081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:43.456734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.456976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.457246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.518430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:43.522280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebe4f-7f44-4995-aa88-9ef66ad72744 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:43.567083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc048d8-a4e7-4a96-b7f7-f9f67da4ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:43.567951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc048d8-a4e7-4a96-b7f7-f9f67da4ff72 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.569770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc048d8-a4e7-4a96-b7f7-f9f67da4ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.570198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc048d8-a4e7-4a96-b7f7-f9f67da4ff72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.571934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc048d8-a4e7-4a96-b7f7-f9f67da4ff72 None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=020e792f68e2488e84a2d16ea12d0c27) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:43.573135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc048d8-a4e7-4a96-b7f7-f9f67da4ff72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:43.577019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc048d8-a4e7-4a96-b7f7-f9f67da4ff72 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:43.589257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 221/429] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:43 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:43.608149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:43.610010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:43.634206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:43.666959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc36234-cc1e-444a-865e-14c6ca063949 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.667147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc36234-cc1e-444a-865e-14c6ca063949 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.667420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc36234-cc1e-444a-865e-14c6ca063949 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.669165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 222/430] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:43.675316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cd10-b170-4d4f-b4e3-716b798b9924 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.675638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cd10-b170-4d4f-b4e3-716b798b9924 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.675957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cd10-b170-4d4f-b4e3-716b798b9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.716536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-65c3cd10-b170-4d4f-b4e3-716b798b9924 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:43.717762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-65c3cd10-b170-4d4f-b4e3-716b798b9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:43.735874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 209/431] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:09:43.741294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:43.841120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 223/432] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:43.842038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cd10-b170-4d4f-b4e3-716b798b9924 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:43.855866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9834-d2ad-4554-9e66-5fca8630703f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:43.881810 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:43.903323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:43.904115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:43.904498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:43.905599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] PATH_INFO: `/v3/projects/020e792f68e2488e84a2d16ea12d0c27` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:43.907728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] RBAC: Authorizing `identity:get_project(project_id=020e792f68e2488e84a2d16ea12d0c27)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:43.909849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:43.911652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 210/433] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:43 2022] GET /identity/v3/projects/020e792f68e2488e84a2d16ea12d0c27 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:43.917985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:43.968234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:43.977619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cd10-b170-4d4f-b4e3-716b798b9924 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.027119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.027809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.028088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.028364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.038234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2faf4-1178-4902-a90d-62fb481da023 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.042603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:44.048204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:44.049184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:44.049984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 224/434] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:44.056540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:44.076839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.077477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.077864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.078144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.079279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:44.081436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:44.083310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 211/435] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:43 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:44.092768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:44.168172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:44.179623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf79c4c-42e6-437b-b6c4-ba118348d25d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.215548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c519def-b97f-49a9-92d3-d216a98bebd1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.227010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.227993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.228273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.228539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.229205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:44.229503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:44.230901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:44.239978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 225/436] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:44.240766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:44.258864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.259823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.260295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.260730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:44.261186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.262758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=020e792f68e2488e84a2d16ea12d0c27) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:44.263348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:44.266975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:44.274352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 212/437] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=020e792f68e2488e84a2d16ea12d0c27&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:44.275159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:44.371816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505378-ee69-42f5-8aa8-4776b0ee79d4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.414291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249800b-b552-4473-958d-4aec310f400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.415323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249800b-b552-4473-958d-4aec310f400e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.415829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249800b-b552-4473-958d-4aec310f400e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.416313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249800b-b552-4473-958d-4aec310f400e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.429787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249800b-b552-4473-958d-4aec310f400e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:44.432936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d9a2-cbbe-49ac-a9b4-ea57f35004c7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6249800b-b552-4473-958d-4aec310f400e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:44.436632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:44.437506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:44.438311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 226/438] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:44.443698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249800b-b552-4473-958d-4aec310f400e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:44.457692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:44.478702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c0f85-929c-4a5d-9573-1deef98d84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.479310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0f85-929c-4a5d-9573-1deef98d84dd None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.479629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0f85-929c-4a5d-9573-1deef98d84dd None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.479897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0f85-929c-4a5d-9573-1deef98d84dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.544068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:44.570077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249800b-b552-4473-958d-4aec310f400e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.572367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c0f85-929c-4a5d-9573-1deef98d84dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:44.574158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c0f85-929c-4a5d-9573-1deef98d84dd None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:44.609976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9bd58-3873-423e-ba7a-d6055fdde0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.610579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9bd58-3873-423e-ba7a-d6055fdde0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.610971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9bd58-3873-423e-ba7a-d6055fdde0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.611132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9bd58-3873-423e-ba7a-d6055fdde0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.611822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9bd58-3873-423e-ba7a-d6055fdde0b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:44.612121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9bd58-3873-423e-ba7a-d6055fdde0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:44.613479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9bd58-3873-423e-ba7a-d6055fdde0b0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:44.622881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 227/439] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:44.624271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c962c2-3b0c-4acd-b9ad-90da96e2fcd9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.624561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c962c2-3b0c-4acd-b9ad-90da96e2fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.624831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c962c2-3b0c-4acd-b9ad-90da96e2fcd9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.626197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 228/440] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:44.628450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c962c2-3b0c-4acd-b9ad-90da96e2fcd9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:44.707618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 213/441] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:44.708964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118557-d34a-4fba-9c87-b2575e99e650 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.709332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118557-d34a-4fba-9c87-b2575e99e650 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.709603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118557-d34a-4fba-9c87-b2575e99e650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.728430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e6118557-d34a-4fba-9c87-b2575e99e650 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:44.729612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e6118557-d34a-4fba-9c87-b2575e99e650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:44.745708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:44.759461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c962c2-3b0c-4acd-b9ad-90da96e2fcd9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.804627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.805237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.805517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.805781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.814861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:44.815657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 214/442] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:44.816661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118557-d34a-4fba-9c87-b2575e99e650 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:44.898139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:44.899962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:44.943885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118557-d34a-4fba-9c87-b2575e99e650 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:44.978797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:44.979348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:44.979653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:44.979936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:44.981044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:44.982476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:44.985636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 215/443] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:44.989577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.012611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.024949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 229/444] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:09:45.030426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.071915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.099013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a8854-bba7-4350-bb5e-6fd3970769cf None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.132495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.132725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b073da-19d4-42c7-9d90-1c1b1213dd57 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.133116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.133392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.133661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.134771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.136235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.137790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 216/445] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:44 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:45.138538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.166664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.167280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.167597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.167873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] PATH_INFO: `/v3/projects/1c6f2245555844ccae44339351591ea6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.168976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=1c6f2245555844ccae44339351591ea6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.170401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.172143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 230/446] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/projects/1c6f2245555844ccae44339351591ea6 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:45.172800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.226064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.240758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20d0f-14ac-4609-97e8-a6f193935409 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d91b5-d82f-4e59-8213-412ce5fda0e3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.273471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.274087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.274364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.274631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.275748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.285329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:45.290535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:45.291595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 217/447] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:45.292414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.304806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.305657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.305657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.305949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.306640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=08098571657746a1bfa166c6cc1dd6a6, scope.project.id=1c6f2245555844ccae44339351591ea6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:45.306946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.308393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.314129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 231/448] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=08098571657746a1bfa166c6cc1dd6a6 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:45.314129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.414363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4acea-8030-4060-8ebb-7d3c91da8599 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.428348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af1bff-0d47-4b89-b72d-5556bb0dc955 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.451265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.451928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.452209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.452469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] PATH_INFO: `/v3/groups/5b323bf382524c9d8e30801afd5c7180` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.453676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] RBAC: Authorizing `identity:get_group(group_id=5b323bf382524c9d8e30801afd5c7180)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.455758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.457489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 218/449] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/groups/5b323bf382524c9d8e30801afd5c7180 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:45.463580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.469020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.469620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.469896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.470184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.471413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:45.471413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.472759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.480512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.486935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 232/450] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:45.488367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.527682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.580376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14d21-cde6-440a-8a25-2d76dab5b419 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.611801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7377c-69d6-429b-ab0d-939a77eeecbc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.624109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.624722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.625001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.625270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.625997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] RBAC: Adding query filter params (group.id=5b323bf382524c9d8e30801afd5c7180, role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=1c6f2245555844ccae44339351591ea6) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:45.626304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.628363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.634544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 219/451] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/role_assignments?group.id=5b323bf382524c9d8e30801afd5c7180&scope.project.id=1c6f2245555844ccae44339351591ea6&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:45.653260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.653896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.654176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.654449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.733698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.735197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.766423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.837698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 233/452] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:09:45.843749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:45.926430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:45.948660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8a5f-c1dc-4c05-afdd-6d638ba71c44 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:45.982274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:45.985418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:45.985418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:45.985418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] PATH_INFO: `/v3/projects/e7e04b96ebc74904845e65316dbf81fa` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:45.985418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] RBAC: Authorizing `identity:get_project(project_id=e7e04b96ebc74904845e65316dbf81fa)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:45.985983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:45.987618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 220/453] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/projects/e7e04b96ebc74904845e65316dbf81fa => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:45.993235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:46.087986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83106d29-7664-48e0-9cd2-3c859dffabf2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:46.116091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:46.120941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ab2cf-e675-4589-8cb0-7fe3546beb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:46.121559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab2cf-e675-4589-8cb0-7fe3546beb47 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:46.121835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab2cf-e675-4589-8cb0-7fe3546beb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:46.122103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab2cf-e675-4589-8cb0-7fe3546beb47 None admin] PATH_INFO: `/v3/groups/c4325e72950f41aba185f1ba92b671a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:46.123186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ab2cf-e675-4589-8cb0-7fe3546beb47 None admin] RBAC: Authorizing `identity:get_group(group_id=c4325e72950f41aba185f1ba92b671a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:46.124645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ab2cf-e675-4589-8cb0-7fe3546beb47 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:46.126203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 234/454] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Sep 6 04:09:45 2022] GET /identity/v3/groups/c4325e72950f41aba185f1ba92b671a6 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:46.132259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:46.228449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4966d9-508e-4a9c-8d8e-966aaa842234 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:46.260671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be880bb2-fc99-4cb1-aaf6-7cc4cb7f16a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:46.261238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880bb2-fc99-4cb1-aaf6-7cc4cb7f16a9 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:46.261508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880bb2-fc99-4cb1-aaf6-7cc4cb7f16a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:46.261771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880bb2-fc99-4cb1-aaf6-7cc4cb7f16a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:46.262472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be880bb2-fc99-4cb1-aaf6-7cc4cb7f16a9 None admin] RBAC: Adding query filter params (group.id=c4325e72950f41aba185f1ba92b671a6, role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=e7e04b96ebc74904845e65316dbf81fa) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:46.262772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be880bb2-fc99-4cb1-aaf6-7cc4cb7f16a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:46.264203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be880bb2-fc99-4cb1-aaf6-7cc4cb7f16a9 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:46.270244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 221/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Sep 6 04:09:46 2022] GET /identity/v3/role_assignments?group.id=c4325e72950f41aba185f1ba92b671a6&scope.project.id=e7e04b96ebc74904845e65316dbf81fa&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:48.529656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c58c-8332-40cd-86fc-146643b01a7b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:48.530202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c58c-8332-40cd-86fc-146643b01a7b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:48.530202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c58c-8332-40cd-86fc-146643b01a7b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:48.531822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 235/456] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:48.537290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cae8f-6a68-4f60-972d-a49d05b557eb None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:48.538082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cae8f-6a68-4f60-972d-a49d05b557eb None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:48.538554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cae8f-6a68-4f60-972d-a49d05b557eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:48.557212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-477cae8f-6a68-4f60-972d-a49d05b557eb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:48.558689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-477cae8f-6a68-4f60-972d-a49d05b557eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:48.561744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:48.630064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 222/457] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:48.837260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6752e6-0ea2-411b-a3ad-1db40f75907c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:48.837905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6752e6-0ea2-411b-a3ad-1db40f75907c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:48.838385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6752e6-0ea2-411b-a3ad-1db40f75907c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:48.839955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 236/458] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:48.847152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5197-1b89-4c6e-a7a8-1dc63f3b5fd6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:48.847709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5197-1b89-4c6e-a7a8-1dc63f3b5fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:48.848188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5197-1b89-4c6e-a7a8-1dc63f3b5fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:48.877109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-576a5197-1b89-4c6e-a7a8-1dc63f3b5fd6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:48.878618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-576a5197-1b89-4c6e-a7a8-1dc63f3b5fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:48.950224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6752e6-0ea2-411b-a3ad-1db40f75907c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:48.952950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 223/459] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:49.140346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6752e6-0ea2-411b-a3ad-1db40f75907c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:49.177073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee439-1d00-4e3c-9e4f-55a346c04f50 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.177727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee439-1d00-4e3c-9e4f-55a346c04f50 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.178204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee439-1d00-4e3c-9e4f-55a346c04f50 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.179808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 224/460] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:49.187022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:49.187920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.188420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.188906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.191893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caa752-f0e1-4451-a5b0-0da01c63c94d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.192418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caa752-f0e1-4451-a5b0-0da01c63c94d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.192893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caa752-f0e1-4451-a5b0-0da01c63c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.203510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:49.205001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:49.213223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e2caa752-f0e1-4451-a5b0-0da01c63c94d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:49.215158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e2caa752-f0e1-4451-a5b0-0da01c63c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:49.226072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:49.227006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:49.227912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:49.227912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:49.227912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:49.227912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 237/461] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:49.233203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:49.299548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:49.305003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 225/462] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:49.307411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caa752-f0e1-4451-a5b0-0da01c63c94d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:49.319538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:49.399061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8fbc3-4cce-44ad-9b36-198a4fba68d1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:49.411082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caa752-f0e1-4451-a5b0-0da01c63c94d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:49.466251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:49.466861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.467136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.467425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.468071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:49.468373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:49.469736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:49.473106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:49.473728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.474003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.474269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.490748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:49.492235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:49.504502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 238/463] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:49.510479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:49.523401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:49.524422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:49.525283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:49.525283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:49.525283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:49.525283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 226/464] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:49.531813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:49.597766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:49.637883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ce14b-929a-4752-96a3-5cf15763db68 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:49.648924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9ab70-ffc1-483b-8acd-1fc8b2ee860a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:49.653026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:49.680798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbb690-68c3-45c8-9604-425d41b5c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:49.681733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbb690-68c3-45c8-9604-425d41b5c16b None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.682187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbb690-68c3-45c8-9604-425d41b5c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.682615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbb690-68c3-45c8-9604-425d41b5c16b None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.683429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbb690-68c3-45c8-9604-425d41b5c16b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:49.685021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbb690-68c3-45c8-9604-425d41b5c16b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:49.686374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158b1d-169d-42a0-bf23-4d7afa83c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:49.686982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158b1d-169d-42a0-bf23-4d7afa83c779 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.687257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158b1d-169d-42a0-bf23-4d7afa83c779 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.687552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158b1d-169d-42a0-bf23-4d7afa83c779 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.688469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158b1d-169d-42a0-bf23-4d7afa83c779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:49.688944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158b1d-169d-42a0-bf23-4d7afa83c779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:49.690447 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158b1d-169d-42a0-bf23-4d7afa83c779 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:49.707749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 239/465] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:49 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:09:49.709196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0143a7-da70-4f46-8495-bbd594758da8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.709541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0143a7-da70-4f46-8495-bbd594758da8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.709822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0143a7-da70-4f46-8495-bbd594758da8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.711199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 240/466] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:49.711794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0143a7-da70-4f46-8495-bbd594758da8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:49.715441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 227/467] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:49.716852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089077ba-a0f4-4c12-a554-2ea9a1b08ed1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.717136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089077ba-a0f4-4c12-a554-2ea9a1b08ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.717415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089077ba-a0f4-4c12-a554-2ea9a1b08ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.738850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-089077ba-a0f4-4c12-a554-2ea9a1b08ed1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:49.740502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-089077ba-a0f4-4c12-a554-2ea9a1b08ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:49.819034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 228/468] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:49.820378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089077ba-a0f4-4c12-a554-2ea9a1b08ed1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:49.841687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0143a7-da70-4f46-8495-bbd594758da8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:49.871837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:49.909566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:49.910423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.910843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.911259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.922695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:49.924910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:49.932141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089077ba-a0f4-4c12-a554-2ea9a1b08ed1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:49.941351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:49.942285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:49.943115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:49.943115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:49.943115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:49.949806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 241/469] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:49.951407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:49.969933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe98f-514b-400b-89f1-9b48269eddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:49.970838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe98f-514b-400b-89f1-9b48269eddf4 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:49.971289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe98f-514b-400b-89f1-9b48269eddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:49.971791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe98f-514b-400b-89f1-9b48269eddf4 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:49.972756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe98f-514b-400b-89f1-9b48269eddf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:49.974493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe98f-514b-400b-89f1-9b48269eddf4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:49.976901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:49.999452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 229/470] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:49 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:09:50.007414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89237-c4a3-4190-b4b0-bb80d3bfa0ec None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.008176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89237-c4a3-4190-b4b0-bb80d3bfa0ec None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.008649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89237-c4a3-4190-b4b0-bb80d3bfa0ec None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.010299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 230/471] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:50.017136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d786f-61a1-4e77-8899-14d358316032 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.017985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d786f-61a1-4e77-8899-14d358316032 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.018203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d786f-61a1-4e77-8899-14d358316032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.039701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-062d786f-61a1-4e77-8899-14d358316032 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:50.040914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-062d786f-61a1-4e77-8899-14d358316032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:50.109223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb585ea-6fdc-4d02-88f1-deb5d021acc0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:50.130503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 231/472] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:50.131771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d786f-61a1-4e77-8899-14d358316032 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:50.161510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:50.162713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.163691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.164330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.165331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:50.165836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:50.167618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:50.169183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:50.185971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 242/473] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:50.193107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:50.254934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d786f-61a1-4e77-8899-14d358316032 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:50.295864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:50.302176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:50.302751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.303063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.304592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.318282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:50.319962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:50.326198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994a5d-fb38-41f5-a1bf-00df208032cc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:50.336744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:50.337666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:50.338532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:50.338532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:50.338532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:50.338532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 232/474] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:50.343611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:50.366093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:50.367033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.367616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.368092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.368970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:50.370645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:50.397556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 243/475] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:50 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:09:50.440385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:50.447468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:50.470996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645448-67e4-4f88-acdc-31f2cc4e8f12 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:50.528095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:50.529060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.529557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.530027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.533259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:50.533907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:50.535590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:50.564741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 233/476] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:50.572205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:50.628455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afc146-c788-4a32-a4aa-b4fae9f4f1cb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:50.668894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:50.670595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.671310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.671784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.672943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:50.675558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:50.681228 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:50.688979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.sql.core [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 04:09:50.688979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 04:09:50.688979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [parameters: {'id': '66774f09fd8846b5b8d5ed42920c0ba9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 04:09:50.688979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81626) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 04:09:50.702701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560f44d-e8b7-43d9-9a1f-93be2af91538 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 06 04:09:50.708555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return ref.to_dict() Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 04:09:50.709426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application yield resource Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise self.value Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application session.commit() Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 04:09:50.710334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.flush() Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application compat.raise_( Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 04:09:50.711205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 04:09:50.712688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 04:09:50.713517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [parameters: {'id': '66774f09fd8846b5b8d5ed42920c0ba9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:50.714302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 04:09:50.715119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:50.717648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 244/477] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Sep 6 04:09:50 2022] POST /identity/v3/roles => generated 144 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:50.717648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:50.742912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:50.743673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.744112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.744482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.745328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:50.746916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:50.761020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:50.778816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 234/478] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:50 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:09:50.844894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4adf8-50fe-4ee5-8668-2d36c83b81d1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:50.887931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025aeb-d086-4b98-8ec7-7bb85346469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:50.888974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025aeb-d086-4b98-8ec7-7bb85346469c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:50.889427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025aeb-d086-4b98-8ec7-7bb85346469c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:50.889870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025aeb-d086-4b98-8ec7-7bb85346469c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:50.901837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025aeb-d086-4b98-8ec7-7bb85346469c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-af025aeb-d086-4b98-8ec7-7bb85346469c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:50.908258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:50.909167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 04:09:50.909952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:50.912699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 245/479] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:09:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:50.918472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:51.051354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3710e-81e5-42dc-9f39-454d3e388e67 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:51.099558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eaf45-f91f-45a7-be99-ab793d6721eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:51.100172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eaf45-f91f-45a7-be99-ab793d6721eb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:51.100447 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eaf45-f91f-45a7-be99-ab793d6721eb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:51.100709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eaf45-f91f-45a7-be99-ab793d6721eb None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:51.101438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eaf45-f91f-45a7-be99-ab793d6721eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:51.101742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eaf45-f91f-45a7-be99-ab793d6721eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:51.103140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eaf45-f91f-45a7-be99-ab793d6721eb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:51.114628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 235/480] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:52.176739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b6c1-eeb6-46a2-9ccb-89a6557a10a1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:52.177280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b6c1-eeb6-46a2-9ccb-89a6557a10a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:52.177280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b6c1-eeb6-46a2-9ccb-89a6557a10a1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:52.178862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 246/481] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:52.184035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf44f6-bf93-4ee2-a9c7-327cc33e6186 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:52.184417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf44f6-bf93-4ee2-a9c7-327cc33e6186 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:52.184593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf44f6-bf93-4ee2-a9c7-327cc33e6186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:52.205368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5bbf44f6-bf93-4ee2-a9c7-327cc33e6186 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:52.206943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5bbf44f6-bf93-4ee2-a9c7-327cc33e6186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:52.270367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:52.287695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 236/482] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:52.618066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a6db2-879b-468f-a813-d48b536cdfe8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:52.618250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a6db2-879b-468f-a813-d48b536cdfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:52.618514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a6db2-879b-468f-a813-d48b536cdfe8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:52.619067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf44f6-bf93-4ee2-a9c7-327cc33e6186 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:52.620110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 247/483] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:52.625249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef694-dbb3-4525-8ec7-cb0d0862230e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:52.625559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef694-dbb3-4525-8ec7-cb0d0862230e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:52.625801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef694-dbb3-4525-8ec7-cb0d0862230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:52.645381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-535ef694-dbb3-4525-8ec7-cb0d0862230e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:52.646573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-535ef694-dbb3-4525-8ec7-cb0d0862230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:52.733432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:52.756119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 248/484] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:09:52.762205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf44f6-bf93-4ee2-a9c7-327cc33e6186 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:52.799250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:52.799972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:52.800256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:52.800531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:52.810993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:52.816391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:52.817272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:52.818084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 237/485] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:09:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:52.825408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ef694-dbb3-4525-8ec7-cb0d0862230e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:52.948687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ef694-dbb3-4525-8ec7-cb0d0862230e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.003394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.003394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.003394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.003394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.003742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:53.003742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:53.003742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:53.017955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 249/486] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:09:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:53.024404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.099845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:53.114139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.157509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc4ec-04ea-4fa6-b4b9-b6e8d2a0d8ec None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.187170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:53.199797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad2d39-9c4a-48db-80e4-8838feb88bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.200910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad2d39-9c4a-48db-80e4-8838feb88bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.201196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad2d39-9c4a-48db-80e4-8838feb88bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.201462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad2d39-9c4a-48db-80e4-8838feb88bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.213768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad2d39-9c4a-48db-80e4-8838feb88bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:53.215668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad2d39-9c4a-48db-80e4-8838feb88bf8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2dad2d39-9c4a-48db-80e4-8838feb88bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:53.234153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:53.235090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:53.236503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:53.236503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:53.236503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:53.239407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 238/487] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:53.239407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8bd34-173b-4533-899e-8a012c3d4ea0 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.239407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8bd34-173b-4533-899e-8a012c3d4ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.239407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8bd34-173b-4533-899e-8a012c3d4ea0 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.244221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 239/488] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:53.244919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14719b26-5fb1-4b1d-bdf3-facd4b27847c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.245150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8bd34-173b-4533-899e-8a012c3d4ea0 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.280972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70c014-e07e-4863-a63d-70b6dfe0f71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.281785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c014-e07e-4863-a63d-70b6dfe0f71d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.282062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c014-e07e-4863-a63d-70b6dfe0f71d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.282332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c014-e07e-4863-a63d-70b6dfe0f71d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.293230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70c014-e07e-4863-a63d-70b6dfe0f71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0c70c014-e07e-4863-a63d-70b6dfe0f71d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:53.299625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:53.301794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 250/489] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:53.303810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2bc5-cbc4-4bb0-8ab2-d5968f7ac9c9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.305594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2bc5-cbc4-4bb0-8ab2-d5968f7ac9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.305594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2bc5-cbc4-4bb0-8ab2-d5968f7ac9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.322797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7d7a2bc5-cbc4-4bb0-8ab2-d5968f7ac9c9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:53.324054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7d7a2bc5-cbc4-4bb0-8ab2-d5968f7ac9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:53.357313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:53.362323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8bd34-173b-4533-899e-8a012c3d4ea0 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.397134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 251/490] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:53.398065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a2bc5-cbc4-4bb0-8ab2-d5968f7ac9c9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.409326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e31769-2cf5-48f1-a463-5b7f9f4ed31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.409935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31769-2cf5-48f1-a463-5b7f9f4ed31c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.410276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31769-2cf5-48f1-a463-5b7f9f4ed31c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.410555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31769-2cf5-48f1-a463-5b7f9f4ed31c None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.411198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31769-2cf5-48f1-a463-5b7f9f4ed31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:53.411604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31769-2cf5-48f1-a463-5b7f9f4ed31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:53.412987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31769-2cf5-48f1-a463-5b7f9f4ed31c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:53.427908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 240/491] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:53.429202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8d67-fd06-443e-8a64-dcba4d5770e3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.429990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8d67-fd06-443e-8a64-dcba4d5770e3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.430344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8d67-fd06-443e-8a64-dcba4d5770e3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.435567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 241/492] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:53.437394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f8d67-fd06-443e-8a64-dcba4d5770e3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.457855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:53.516014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a2bc5-cbc4-4bb0-8ab2-d5968f7ac9c9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.551288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc317-ada1-4b63-80e5-23b2fac2e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.552074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc317-ada1-4b63-80e5-23b2fac2e64d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.552351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc317-ada1-4b63-80e5-23b2fac2e64d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.552620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc317-ada1-4b63-80e5-23b2fac2e64d None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.553280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc317-ada1-4b63-80e5-23b2fac2e64d None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:53.553868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc317-ada1-4b63-80e5-23b2fac2e64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:53.555266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc317-ada1-4b63-80e5-23b2fac2e64d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:53.567444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 252/493] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:53.569027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53c0d-8e82-4688-9b59-099d74a33b30 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.569526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53c0d-8e82-4688-9b59-099d74a33b30 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.569995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53c0d-8e82-4688-9b59-099d74a33b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.578495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f8d67-fd06-443e-8a64-dcba4d5770e3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.593422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9cb53c0d-8e82-4688-9b59-099d74a33b30 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:53.595009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9cb53c0d-8e82-4688-9b59-099d74a33b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:53.614444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.615072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.615344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.615640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.622872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:53.624345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:09:53.637467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:53.638479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:53.639401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 242/494] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:53.639972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.663730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:53.679658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 253/495] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:53.680891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53c0d-8e82-4688-9b59-099d74a33b30 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.720025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:53.754878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bbba0-a301-48e9-8cff-77536f2418f8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.790839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.791488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.791768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.791898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53c0d-8e82-4688-9b59-099d74a33b30 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.792100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.802899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:53.804162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:53.818357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:53.819235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:53.820135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:53.820135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:53.820135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:53.820135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 243/496] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:53.820347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.832435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99a52-9759-4778-9ebb-bba075087f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.833040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99a52-9759-4778-9ebb-bba075087f58 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.833315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99a52-9759-4778-9ebb-bba075087f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.833772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99a52-9759-4778-9ebb-bba075087f58 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.834325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99a52-9759-4778-9ebb-bba075087f58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:53.834629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99a52-9759-4778-9ebb-bba075087f58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:53.836079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99a52-9759-4778-9ebb-bba075087f58 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:53.880004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 254/497] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:53.882151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5cb0f-91d6-4487-aaa9-0ad9cb62c22e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.882436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5cb0f-91d6-4487-aaa9-0ad9cb62c22e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.882707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5cb0f-91d6-4487-aaa9-0ad9cb62c22e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.884992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 255/498] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:53.885725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5cb0f-91d6-4487-aaa9-0ad9cb62c22e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.903726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:53.934315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5395de5-62ee-4c40-b3f1-22f8587f6d5d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:53.967361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:53.968005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:53.968291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:53.968551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:53.979250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:53.984449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:53.985318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 244/499] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:53.986436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:53.991506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.002438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5cb0f-91d6-4487-aaa9-0ad9cb62c22e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.037652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac81b3a-7a34-449b-b193-987bc06d07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.038261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac81b3a-7a34-449b-b193-987bc06d07c5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.038552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac81b3a-7a34-449b-b193-987bc06d07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.038822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac81b3a-7a34-449b-b193-987bc06d07c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.039484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac81b3a-7a34-449b-b193-987bc06d07c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:54.039785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac81b3a-7a34-449b-b193-987bc06d07c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.041157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac81b3a-7a34-449b-b193-987bc06d07c5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.057143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 256/500] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:54.057143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a15e2-5404-4d3b-aeff-ba3085aae3ce None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.057143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a15e2-5404-4d3b-aeff-ba3085aae3ce None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.057143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a15e2-5404-4d3b-aeff-ba3085aae3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.072742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d85a15e2-5404-4d3b-aeff-ba3085aae3ce None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:54.073933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d85a15e2-5404-4d3b-aeff-ba3085aae3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:54.091729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703137f-0e79-4749-9268-663cb487b656 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.121094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.126235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.126854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.127137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.127445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.139249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 257/501] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:54.140100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a15e2-5404-4d3b-aeff-ba3085aae3ce None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.204354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.205953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.222528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.253371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a15e2-5404-4d3b-aeff-ba3085aae3ce None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.291704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63650-0362-47b2-81da-0da213949103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.292444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63650-0362-47b2-81da-0da213949103 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.292724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63650-0362-47b2-81da-0da213949103 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.292989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63650-0362-47b2-81da-0da213949103 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.304735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b63650-0362-47b2-81da-0da213949103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-92b63650-0362-47b2-81da-0da213949103 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:54.309678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:54.310552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:54.311361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 258/502] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:54.312484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63650-0362-47b2-81da-0da213949103 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.321737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 245/503] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:54.322494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.353894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.421594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63650-0362-47b2-81da-0da213949103 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.423045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e954ef5-0878-4fbc-8494-5c4f5e3b2e20 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.455386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.455986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.456267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.456531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.457184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:54.457340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.457482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.457942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.458212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.458475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.458852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.465347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.466546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 259/504] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:54.466774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.467321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.471270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:09:54.481958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:54.482852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:54.483759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 246/505] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:54.484318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.572740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57f87-c19d-4efd-9573-a2dd53442d96 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.578781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.588588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0e76-72d1-441c-988a-73fb7b14bd36 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.605898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.606499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.606775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.607045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.607736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:54.608046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.609406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.617206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 260/506] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:54.617964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.621487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.622194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.622464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.622728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.633253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.634794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:54.648789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:54.649745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:54.650580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:54.650580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.650580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:54.650580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 247/507] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:54.651061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.684800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.718201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1eba-5874-45cc-93bd-c87f75fb36a7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.747675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824cbd5-3ac9-4326-bacb-4707146ef582 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.751706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.752648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.752900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.753170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.763844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.765300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:54.779887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:54.780966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:54.782022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:54.782022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.782022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:54.782022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 261/508] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:54.782022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.783741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.784362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.784633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.784896 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.795879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.797472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.800771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:54.814598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:54.815532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:54.816396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:54.816396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.816396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:54.816396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 248/509] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:54.816617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.885893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b6f0-e4c7-482f-8a75-f22bf99e6965 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.902751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:54.916712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd414372-a032-4d5d-ba29-994e08420092 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:54.919908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.920497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.920775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.921039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.921747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:54.922041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.924072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.940363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 262/510] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:54.941213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:54.955096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:54.955749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:54.956025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:54.956299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:54.966728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:54.968207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:54.982586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:54.983665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:54.984742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:54.984742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:54.984742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:54.985629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 249/511] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:54.986897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.035477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.043733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d731-f90e-4684-ac4f-8aeaf8c00dc5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.077399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.077994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.078274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.078542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.079173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:55.079503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.080880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.086058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877f9b3-b46e-463b-8663-e430d81c1247 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.091652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 263/512] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:55.092428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.119990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.120596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.120870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.121140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.121783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:55.122082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.123497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.131324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.135562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 250/513] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:55.136212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.198105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b8d22-f2d5-4f43-9185-6b89252b7783 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.230859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.231515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a774cf-012c-455d-9f30-2e4c8a612d1c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.231863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.231863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.231997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.232631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:55.232932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.234298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.241242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.246390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 264/514] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:55.247171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.270957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.271614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.271890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.272159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.338693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.340172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.340922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.347090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6769-a9e7-41d4-9cec-e970c5b0c913 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.381003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.381854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.382131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.382399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.383032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:55.383331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.384723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.395484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 265/515] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:55.396199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.440319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 251/516] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:55.441182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.452284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.493932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff271d8-3df2-448f-9c33-b95c6ff762a7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.526834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.527474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.527751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.528017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.534653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.536267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.538539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c316-95e6-4c52-ad18-954675d238c5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:09:55.550796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:55.551720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 266/517] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:55.556418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.571051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.580229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.580840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.581117 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.581385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.582023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.583480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.604341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 252/518] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:09:55 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:09:55.605141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.670206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4325e2-58fb-4400-b496-4dae6cf30690 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.675364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.708647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.709283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.709558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.709821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.718055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.719234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d7eb2-cd2b-40bb-8125-9755af99f9a8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.719554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:09:55.733417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:55.734622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:09:55.735803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:55.740335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 267/519] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:55.741278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.762173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.762809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.763137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.763483 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.771081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.772584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:09:55.785400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:55.786385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:55.787304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 253/520] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:55.788712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.829602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.855270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321981-d405-4774-a852-ba1beaff56dd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.891841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.892495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.892799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.893068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.895221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62f2b-c432-485d-8f64-cbaced267be2 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:55.910489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.912260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.925126 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:55.927572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:55.928467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:55.930024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:55.930024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:55.930024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:55.930024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 268/521] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:55.930024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:55.940922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:55.941533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:55.941809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:55.942080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:55.942838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:55.943152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:55.944670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:55.966522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 254/522] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:55.967348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.053522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8d945-605a-4189-96a2-1ba382e33e29 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.078551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6920f-98b0-439a-901a-3aaf4e19531a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.082371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:56.093107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.094241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.094527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.094953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.096284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:56.096594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.098084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.115701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 269/523] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:56.116021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.116511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.117084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.117367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.117641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.118393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:56.118705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.120296 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.158830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 255/524] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Sep 6 04:09:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:56.159944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.207268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:56.233367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e601ce-1a36-4325-b7bb-95ad618c3894 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.271394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.272004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.272281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.272550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.273182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:56.273486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.274733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c95a-b81d-41b6-90fc-2bf4d5707697 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.275172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.288894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 270/525] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:56.289909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.315994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.316593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.316868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.317137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.317855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=88339d0387834b8b8e833579efd7ee96) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:56.318164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.319724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.325634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 256/526] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/role_assignments?user.id=88339d0387834b8b8e833579efd7ee96&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:56.326464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.350590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:56.411342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a5531-7acd-4d37-99a8-3afb9a326269 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.449353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.450289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.450748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.451223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.471215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56de2a7-4f5d-4b7c-933a-cd3c7e53af42 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.482403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:56.524975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.525696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.525987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.526498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.532420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.535863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.603056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:56.611553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.613335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.683531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 271/527] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:56.685707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.733894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 257/528] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:09:56.734810 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.746102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:56.795527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce944-2cd5-4e01-ae17-87dc2d2e26b9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.831299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.832349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.833321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.840493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.842258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:09:56.854218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:56.855080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:56.856056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:56.858445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 272/529] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:56.859464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.865169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270f9cc-d301-4d75-839f-210e1ba66861 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:56.871690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:56.902004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:56.902989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:56.903514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:56.904005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:56.916544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:56.918377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:56.933472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:56.934376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:56.935235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:56.935235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:56.935235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:56.936982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 258/530] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:56.937969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:56.987472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02297-3c1c-4599-aa62-fa33155b6a91 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.016268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:57.037555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.038394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.039256 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.039743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.053771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.056407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.064739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7e2c9-2b5c-45c4-87f0-d23f466e5fea None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:57.076403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:57.077508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:57.078546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:57.078546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:57.078546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:57.080673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 273/531] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:57.082188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.103745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.104489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.104999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.105276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.106104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:57.106504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.108157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.122338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 259/532] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:09:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:57.123522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.164535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:57.218119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da6b86-585d-4961-b9f3-6e6b6939c2a8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.245124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402444a-bcf3-4538-be10-da7c4f70d74a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.264143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:57.266028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.267714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.268372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.269332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.270627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:57.271577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.273411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.284870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.285600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.286009 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.286385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.287179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:57.287644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.289130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.295618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 274/533] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:57.296370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.310216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 260/534] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:57.311656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.407490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017a63c-aa8d-4bc6-900b-fac4f31d27db None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.426123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:57.446002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.446938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.447299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.447682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.448877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=6b07846b067c4073b5701db6e9232d0b) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:57.449193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.451053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.455198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16ffa1-251a-4e11-bb98-8ef93fb84344 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.457407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 275/535] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/role_assignments?user.id=6b07846b067c4073b5701db6e9232d0b&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:57.460213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.507139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.509264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.509264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.509264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.518092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.519674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:09:57.544262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:57.545164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:57.546007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:57.553831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 261/536] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:57.557056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.619624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:57.654964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167df58-6037-44c1-8b6e-a37fe644f8c3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.691107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c414f-879b-4812-a2d9-98e9e4938b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.691784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c414f-879b-4812-a2d9-98e9e4938b4c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.692063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c414f-879b-4812-a2d9-98e9e4938b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.692331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c414f-879b-4812-a2d9-98e9e4938b4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.701715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c414f-879b-4812-a2d9-98e9e4938b4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.703872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c414f-879b-4812-a2d9-98e9e4938b4c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.705902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386dadc-6858-47e6-b35f-006ea557f67e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d92c414f-879b-4812-a2d9-98e9e4938b4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:09:57.718111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:57.718999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:57.719959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 276/537] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:57.720898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083129ce-6d5b-4b0f-b270-1fa15d888173 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.721125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083129ce-6d5b-4b0f-b270-1fa15d888173 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.721397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083129ce-6d5b-4b0f-b270-1fa15d888173 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.727064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 277/538] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:57.728509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6eb7-8013-4fc4-a9a2-16beccaf0c9d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.728795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6eb7-8013-4fc4-a9a2-16beccaf0c9d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.729069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6eb7-8013-4fc4-a9a2-16beccaf0c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.752854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0bce6eb7-8013-4fc4-a9a2-16beccaf0c9d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:57.754019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:57.754149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0bce6eb7-8013-4fc4-a9a2-16beccaf0c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:57.754944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:57.755456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:57.756213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:57.758300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:57.758816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:57.760551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:57.777198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 262/539] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:57.778913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.796837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:57.847424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 278/540] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:57.847424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6eb7-8013-4fc4-a9a2-16beccaf0c9d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:57.965455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:57.975516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d9360-2a38-4e06-8c46-e0ae54b70a5b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:58.005223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6eb7-8013-4fc4-a9a2-16beccaf0c9d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:58.039492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:58.040046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.040324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.040594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.041377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:58.041483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:58.041686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:58.042240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.042582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.042919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.043125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:58.043791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=fa181d21ba124c4ba2efd96ddecf5f06) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:58.044159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:58.045842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:58.053089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 279/541] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/role_assignments?user.id=fa181d21ba124c4ba2efd96ddecf5f06&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:58.079303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 263/542] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:58.085510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:58.159195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:58.164609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:58.293482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b1e53-5f6d-4950-8b7b-7fd9fb33009d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:58.334458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f76b8-2963-444a-a5fc-c1e8cce3962c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:58.369816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:58.370445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.370722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.370992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.382272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:58.384077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440d632-9cb6-45bb-a07a-8d741a08bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:58.384697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440d632-9cb6-45bb-a07a-8d741a08bb93 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.384976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440d632-9cb6-45bb-a07a-8d741a08bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.385244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440d632-9cb6-45bb-a07a-8d741a08bb93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.385971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440d632-9cb6-45bb-a07a-8d741a08bb93 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=bf28e8b35a8246778b66c59164947add) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:58.386274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440d632-9cb6-45bb-a07a-8d741a08bb93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:58.387181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:58.388094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:58.388892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:58.389494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440d632-9cb6-45bb-a07a-8d741a08bb93 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:58.389564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 264/543] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:09:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:09:58.396066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:58.402515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 280/544] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:09:58 2022] GET /identity/v3/role_assignments?user.id=bf28e8b35a8246778b66c59164947add&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:58.471781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:58.501136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd591f-b525-4f0f-b54e-45a1b3bb1a51 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.502331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd591f-b525-4f0f-b54e-45a1b3bb1a51 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.502813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd591f-b525-4f0f-b54e-45a1b3bb1a51 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.504801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 281/545] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:09:58.509458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aad12b-d0c3-4bc0-95c1-51cf975b166c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:58.511088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f4559-485e-47df-a583-9f45ea1c4ad9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.511627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f4559-485e-47df-a583-9f45ea1c4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.512103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f4559-485e-47df-a583-9f45ea1c4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.531304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a20f4559-485e-47df-a583-9f45ea1c4ad9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:09:58.532962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a20f4559-485e-47df-a583-9f45ea1c4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:09:58.550938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:58.551885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.552758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.553187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.553906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:58.554272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:58.556650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:58.572725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 265/546] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:09:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:58.573957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:58.665313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 282/547] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:09:58.716039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:58.725699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009c64-2007-48b1-a4c0-09aaca46a438 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:58.761384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:58.762078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:58.762355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:58.762662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:58.774053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:58.775619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:58.792148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:58.793089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:58.793920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:58.793920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:58.793920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:58.793920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 266/548] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:58.800907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f4559-485e-47df-a583-9f45ea1c4ad9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:58.838226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:58.967092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f4559-485e-47df-a583-9f45ea1c4ad9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.024075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.024691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.024966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.025233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.025880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:59.026175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.027560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.044438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 283/549] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:59.049938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.061460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.157052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:59.164948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b764-cc85-4c49-9273-af184567d612 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.169380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caa91c-385d-4f7d-b8b1-bfa769c3a595 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.199408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.199995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.200272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.200603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.203694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:59.208315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.209197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.209701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.210269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.215708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.217332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.223093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:09:59.229215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:59.230387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:09:59.231213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:59.233843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 284/550] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:59.239650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:09:59.248759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:59.249727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:09:59.250841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:09:59.254604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 267/551] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:59.264372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.359040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1a651-7eb0-4f49-bcd0-cd9790e881aa None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.396253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.397239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.397726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.398203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.399068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:59.399631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.401222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.409811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 285/552] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:59.414413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8250d80-05cd-4fb8-b88c-d6a81df44796 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.415880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.431067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:59.446809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.447588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.447773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.448041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.448776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:59.449069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.450507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.475734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 268/553] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:09:59.480332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.526242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6515e-e565-416f-8fe3-5e7ade19c898 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.567753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:59.569591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.570237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.570524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.570798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.593061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.594531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:09:59.609385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:59.610311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:09:59.611205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:09:59.611205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:09:59.611205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:59.611205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 286/554] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:59.616191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.661730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e120d1-4e63-4971-af84-dc80fcb07b81 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.682873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:59.724639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08cb34-a6dc-42c1-9542-95ef5d3057b9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.760248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.761243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.761728 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.762201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.763067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:09:59.763593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.765201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.778945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 287/555] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:09:59.784690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3574444-e428-4266-a945-4cd1d924e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.785310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3574444-e428-4266-a945-4cd1d924e60a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.785587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3574444-e428-4266-a945-4cd1d924e60a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.785853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3574444-e428-4266-a945-4cd1d924e60a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.786182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:09:59.899274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a61e2-8931-4202-8742-a4247e778ee7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:09:59.911220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3574444-e428-4266-a945-4cd1d924e60a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.913490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3574444-e428-4266-a945-4cd1d924e60a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.927320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:59.940670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f08f2-35a6-479f-8942-8dd4892c6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:09:59.941695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f08f2-35a6-479f-8942-8dd4892c6252 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.942184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f08f2-35a6-479f-8942-8dd4892c6252 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.942661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f08f2-35a6-479f-8942-8dd4892c6252 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.951327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f08f2-35a6-479f-8942-8dd4892c6252 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:09:59.953197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f08f2-35a6-479f-8942-8dd4892c6252 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c20f08f2-35a6-479f-8942-8dd4892c6252 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:09:59.967098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:09:59.968828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:09:59.969760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:09:59.973291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 288/556] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:09:59.977470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:09:59.979587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b367d-f559-4d4d-b392-7f4c32bda15d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:09:59.980078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b367d-f559-4d4d-b392-7f4c32bda15d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:09:59.980450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b367d-f559-4d4d-b392-7f4c32bda15d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:09:59.985991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 289/557] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:09:59.985991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b367d-f559-4d4d-b392-7f4c32bda15d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.056553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 269/558] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:10:00.056941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b49031-e5cf-4fd7-a878-5c2f79b09ca8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.057185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b49031-e5cf-4fd7-a878-5c2f79b09ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.057805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b49031-e5cf-4fd7-a878-5c2f79b09ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.077074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b6b49031-e5cf-4fd7-a878-5c2f79b09ca8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:00.078289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b6b49031-e5cf-4fd7-a878-5c2f79b09ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:00.115763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b367d-f559-4d4d-b392-7f4c32bda15d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.155399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 270/559] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:00.155399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b49031-e5cf-4fd7-a878-5c2f79b09ca8 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.161834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7349-8127-4809-bb5c-4dd42625c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.162700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7349-8127-4809-bb5c-4dd42625c76e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.163234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7349-8127-4809-bb5c-4dd42625c76e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.163887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7349-8127-4809-bb5c-4dd42625c76e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.164836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7349-8127-4809-bb5c-4dd42625c76e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:00.165347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7349-8127-4809-bb5c-4dd42625c76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:00.167149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7349-8127-4809-bb5c-4dd42625c76e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:00.193289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 290/560] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:09:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:00.195124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4b8c-4a4e-4e8c-ace3-373187d875be None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.195641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4b8c-4a4e-4e8c-ace3-373187d875be None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.196120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4b8c-4a4e-4e8c-ace3-373187d875be None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.197823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 291/561] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:00.199251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc4b8c-4a4e-4e8c-ace3-373187d875be None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.240277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:00.249697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:00.262489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b49031-e5cf-4fd7-a878-5c2f79b09ca8 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.298996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d19b6c-c784-4a94-8d79-dff1c0516212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.299681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d19b6c-c784-4a94-8d79-dff1c0516212 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.299961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d19b6c-c784-4a94-8d79-dff1c0516212 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.300231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d19b6c-c784-4a94-8d79-dff1c0516212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.311508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d19b6c-c784-4a94-8d79-dff1c0516212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:00.313114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d19b6c-c784-4a94-8d79-dff1c0516212 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:00.316687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc4b8c-4a4e-4e8c-ace3-373187d875be None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-e3d19b6c-c784-4a94-8d79-dff1c0516212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:00.329137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:00.336604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:00.338799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:00.338799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:00.338799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:00.338799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 271/562] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:00.338799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687cef7-5105-4c7d-bde7-cf3fa0f21cf7 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.338799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687cef7-5105-4c7d-bde7-cf3fa0f21cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.338799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687cef7-5105-4c7d-bde7-cf3fa0f21cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.356925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c687cef7-5105-4c7d-bde7-cf3fa0f21cf7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:00.358034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c687cef7-5105-4c7d-bde7-cf3fa0f21cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:00.365354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.366616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.367123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.367642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.379633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:00.381427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:00.398483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:00.399495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:00.400387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:00.400387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:00.400387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:00.402447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 292/563] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:00.403451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.437578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 272/564] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:00.438698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687cef7-5105-4c7d-bde7-cf3fa0f21cf7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.504686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:00.509829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:00.517040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39abad-cb93-41ca-a98e-1592482205a8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.544937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687cef7-5105-4c7d-bde7-cf3fa0f21cf7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.556567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.557914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.558675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.559241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.560311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:00.560919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:00.562511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:00.579176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 293/565] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:00.580411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.586831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.587526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.587809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.588084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.588735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:00.589041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:00.590741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:00.607354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 273/566] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:00.608245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.687232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13edc3-58eb-4c55-b77b-67157d6a2fcc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.711699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea9ef-68a2-4643-aff2-2e720c9f6023 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.724513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.725576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.726249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.726718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.735367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:00.738576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:00.743449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:00.744354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:00.745178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 294/567] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:00.745848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.755024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.755694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.755975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.756246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.763314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:00.763751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:00.765242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:00.777776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:00.778652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:00.779564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 274/568] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:00.780073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.860124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae28c9-d39a-4bf6-9d40-925dae2922ef None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.880647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d0-0271-4590-b411-4f0a28212218 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:00.893770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.894391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.894670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.894941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.901507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:00.902934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:00.913724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:00.914337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:00.914612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:00.914706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:00.915806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:00.916744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:00.917161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:00.917241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 295/569] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:00.917241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.927800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:00.933031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:00.934189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 275/570] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:00.935127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:00.976549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:00.994020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.018810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2e3f-8c2c-41d9-88b9-0a651c179e32 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.038109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cc2b4-7827-48ef-b5db-d70755a6c9b1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.051984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fde36-5688-46fe-9c32-a0d5d8558252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.052587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fde36-5688-46fe-9c32-a0d5d8558252 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.052865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fde36-5688-46fe-9c32-a0d5d8558252 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.053135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fde36-5688-46fe-9c32-a0d5d8558252 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.053820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fde36-5688-46fe-9c32-a0d5d8558252 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:01.054121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fde36-5688-46fe-9c32-a0d5d8558252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.055510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fde36-5688-46fe-9c32-a0d5d8558252 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.063111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 296/571] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:01.064857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a35b-1a17-4ade-af29-ae747d887385 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.065282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a35b-1a17-4ade-af29-ae747d887385 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.065458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a35b-1a17-4ade-af29-ae747d887385 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.067494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 297/572] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:01.068801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a35b-1a17-4ade-af29-ae747d887385 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.073204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.073811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.074087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.074354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.075038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:01.075340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.076799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.089300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 276/573] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:01.090007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.171705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a35b-1a17-4ade-af29-ae747d887385 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.185968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfa41-ce06-4469-af47-bfb35e47da44 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.187464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.205395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.205996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.206271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.206540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.207219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:01.207555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.208970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.212856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.222007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941b279-6fab-482d-be51-a56940021d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.222598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b279-6fab-482d-be51-a56940021d63 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.222871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b279-6fab-482d-be51-a56940021d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.223135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b279-6fab-482d-be51-a56940021d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.223811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b279-6fab-482d-be51-a56940021d63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:01.224122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b279-6fab-482d-be51-a56940021d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.225456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b279-6fab-482d-be51-a56940021d63 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.227116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 298/574] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:01.228207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.233372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 277/575] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:01.234520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e668-7b80-42e9-9763-aa9f1721d1b6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.234805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e668-7b80-42e9-9763-aa9f1721d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.235069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e668-7b80-42e9-9763-aa9f1721d1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.253283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3d30e668-7b80-42e9-9763-aa9f1721d1b6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:01.254459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3d30e668-7b80-42e9-9763-aa9f1721d1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:01.320459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 278/576] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:01.321565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30e668-7b80-42e9-9763-aa9f1721d1b6 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.329724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060fdd1-24d1-4b7f-9c80-9856d53bc600 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.377909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.378796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.379078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.379348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.393634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.395073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:01.410140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:01.411071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:01.412288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:01.412288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:01.412288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:01.412288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 299/577] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:01.412288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.419820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.426456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30e668-7b80-42e9-9763-aa9f1721d1b6 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.463658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.465064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.465603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.465876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.466592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=f7aaf3229ccf44718004798534537abc) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:01.466895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.468238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.469082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.475223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 279/578] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/role_assignments?user.id=f7aaf3229ccf44718004798534537abc&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:01.476055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.550771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf5bd0-7f85-4607-af74-524ac8b4ac18 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.592529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.593662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.594209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.594484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/88339d0387834b8b8e833579efd7ee96/roles/d43a5dcacbf942afad5a4c0cbfb314a2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.603311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c125270-cb79-4d80-95e5-5a1bd4ba2d20 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.612468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=88339d0387834b8b8e833579efd7ee96, role_id=d43a5dcacbf942afad5a4c0cbfb314a2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.613941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.635414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 300/579] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:01 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/88339d0387834b8b8e833579efd7ee96/roles/d43a5dcacbf942afad5a4c0cbfb314a2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:01.635414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.652893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.653924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.654200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.654469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.670295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.673219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:01.693363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:01.694364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:01.695236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:01.695236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:01.695236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:01.697719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 280/580] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:01.699047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.713281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.747212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.751532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270c28e-e537-4d49-893f-a2e20b669183 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.791850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.792517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.793091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.793362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.794015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:01.794312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.795850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.809831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 301/581] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:01.810628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.823190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc8ec7-c2ad-4134-a90c-3e4f7a914af0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.869494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.870118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.870391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.870656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.885493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:01.893131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:01.894088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 281/582] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:01.895537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:01.930069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e19d6b-ce9d-47d8-8e6c-284cf639a7f9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:01.969370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:01.970973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:01.971571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:01.972048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:01.972890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:01.973557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:01.975253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:01.987203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:01.994501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 302/583] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:01.995735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.022944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:02.031509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff164e0-2f08-4196-bdbc-9d570d47fba2 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.069831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.070921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.071508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.071982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.082211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.084389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:02.097288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:02.098361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 04:10:02.099307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:02.106314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 282/584] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:02.107471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.123759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b1da2-45d5-4190-a7a2-4f48bba711d6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.166518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.167127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.167444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.168426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.169100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:02.169693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.171245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.182492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 303/585] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:02.183941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.220919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d6a0-538f-4c11-b778-3a9bcd2017dd None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.251754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:02.263923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.264853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.265316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.265769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.274588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.276375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.284199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:02.290008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:02.291130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:10:02.292333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:02.294440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 283/586] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:02.295339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.313688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa252a-35ec-44da-a045-f3f12e4e91bb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.352898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.353430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.353810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.354201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.355009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:02.355444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.356985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.380293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 304/587] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:02.381226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.418001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58068d7-330d-4431-a21a-775fa50cec49 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.455298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.456292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.456783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.457227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.469320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.472221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:02.488026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:02.488987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:02.489865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:02.489865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:02.489865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:02.492332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 284/588] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:02.493257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.495268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326db40-bbf8-4ddd-b783-f64dddc88716 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.540023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.540826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.541205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.541577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.542860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:02.543271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.544273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:02.546070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.556467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:02.571467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 305/589] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:02.572552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.621088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682bbd-2c21-4ace-b3ff-f2566b706fa2 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.660467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.661370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.661831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.662272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.674054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.675907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:02.691345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:02.692539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:02.693632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:02.693632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:02.693632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:02.695528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 285/590] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:02.696521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.713333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97949-d4c3-42fe-a69e-c596beea43a0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.753562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.754433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.754854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.755263 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.756091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:02.756608 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.758371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.770877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 306/591] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:02.771870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.806355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:02.819413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f308745-62de-4540-970d-ba030d7ace0b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.829479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:02.854288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.854920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.855199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.855731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.867326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.869122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.879138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f557e41-efa9-4c63-946a-3040c3080722 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:02.885346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:02.886477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:02.887510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:02.887510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:02.887510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:02.891223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 286/592] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:02.892151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:02.918147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:02.919274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:02.919715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:02.920153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:02.920931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:02.921364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:02.922859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:02.934883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 307/593] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:02.935904 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.006464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036445-fa92-43aa-8f67-13b44380ef93 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.040715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca5d51-a703-4608-8d07-b7a634ce5721 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.043967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.044402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.044681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.044955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.053232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.054687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.059748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:03.069376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:03.070312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:03.071235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 287/594] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:03.072034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.082248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.082912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.083711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.084258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.084774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.085630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:03.086132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.087678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.100241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 308/595] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:03.101246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.190118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca640e2-14db-448a-ba5d-7d24d966c323 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.205599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568c1b2-1680-4ccd-a3cb-2890afe881ef None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.227574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.228204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.228485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.228758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.236898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.238358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.241724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.242512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.242932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.243402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.244326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:03.244768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.246382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:03.250203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:03.251245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:03.252878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:03.256596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 288/596] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:03.257695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.269298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 309/597] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:03.270332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.304849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.333830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.372847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f4f4d-99b9-4024-a49c-3d5ab78f369d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.378680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d993a-8c71-47be-b797-9acff0b54838 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.410958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.411715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.411995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.412267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.416714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.417804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.418221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.418668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.419266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.419688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:03.420128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.420744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.421821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:03.433226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:03.434305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:03.435217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:03.437523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 310/599] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:03.438504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.439680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 289/599] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:03.447976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.537606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.545428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041876-3d74-45d9-8bd6-4e5201439b31 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.555321 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e9224-8cce-4a54-a795-edc9b075d17f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.579229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c751a-c995-4922-984a-b7f8502d8d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.580020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c751a-c995-4922-984a-b7f8502d8d3f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.580364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c751a-c995-4922-984a-b7f8502d8d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.580702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c751a-c995-4922-984a-b7f8502d8d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.581358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.591762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c751a-c995-4922-984a-b7f8502d8d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.592020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.592617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.592891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.593157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.593535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c751a-c995-4922-984a-b7f8502d8d3f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.593835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:03.594137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.596200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.608429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 290/600] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:03.609023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4d9c751a-c995-4922-984a-b7f8502d8d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:03.613976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:03.615098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:03.616207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:03.616207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:03.616207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:03.622080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 311/601] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:03.622080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c4460-60e5-41b5-8905-53a4a333b9f4 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.622080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c4460-60e5-41b5-8905-53a4a333b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.622080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c4460-60e5-41b5-8905-53a4a333b9f4 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.622080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 312/602] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:03.622080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c4460-60e5-41b5-8905-53a4a333b9f4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.718255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e9fbf-0119-4950-a9a2-9bb503427d51 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.735201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c4460-60e5-41b5-8905-53a4a333b9f4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.751840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.752488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.752760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.753023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/6b07846b067c4073b5701db6e9232d0b/roles/d43a5dcacbf942afad5a4c0cbfb314a2` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.766812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=6b07846b067c4073b5701db6e9232d0b, role_id=d43a5dcacbf942afad5a4c0cbfb314a2)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.768293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.769047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5adbc-4c10-4010-97ba-45616f9bc119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.769688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5adbc-4c10-4010-97ba-45616f9bc119 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.769965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5adbc-4c10-4010-97ba-45616f9bc119 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.770236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5adbc-4c10-4010-97ba-45616f9bc119 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/fa181d21ba124c4ba2efd96ddecf5f06/roles/d43a5dcacbf942afad5a4c0cbfb314a2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.781102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 291/603] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:03 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/6b07846b067c4073b5701db6e9232d0b/roles/d43a5dcacbf942afad5a4c0cbfb314a2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:03.781690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:03.800652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5adbc-4c10-4010-97ba-45616f9bc119 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=fa181d21ba124c4ba2efd96ddecf5f06, role_id=d43a5dcacbf942afad5a4c0cbfb314a2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.802866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5adbc-4c10-4010-97ba-45616f9bc119 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.807629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.821102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 313/604] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:03 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/fa181d21ba124c4ba2efd96ddecf5f06/roles/d43a5dcacbf942afad5a4c0cbfb314a2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:03.822130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad9ac-7609-4c8f-9581-104f97052b9f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.822441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad9ac-7609-4c8f-9581-104f97052b9f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.822671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad9ac-7609-4c8f-9581-104f97052b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.826625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:03.842339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-281ad9ac-7609-4c8f-9581-104f97052b9f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:03.843620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-281ad9ac-7609-4c8f-9581-104f97052b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:03.919673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1e2b-bad6-4b1a-85f7-11a09040ba1c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:03.939877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 314/605] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:03.941540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac443-e4d8-4dce-88c2-1e87e8e501ef None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.941931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac443-e4d8-4dce-88c2-1e87e8e501ef None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.942302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac443-e4d8-4dce-88c2-1e87e8e501ef None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.944129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 315/606] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:03.956076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e24c-3ed2-4e96-abbd-7791200f23a0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.956508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e24c-3ed2-4e96-abbd-7791200f23a0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.956871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e24c-3ed2-4e96-abbd-7791200f23a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.969230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:03.969780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:03.970110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:03.975399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:03.975399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:03.975399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:03.975399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:03.986640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4561e24c-3ed2-4e96-abbd-7791200f23a0 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:03.986640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4561e24c-3ed2-4e96-abbd-7791200f23a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:03.987067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 292/607] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:03.998197 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.069667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 316/608] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:10:04.118490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:04.125480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56896ade-9afb-4840-8cc0-685feb4bc21d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:04.172215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:04.172848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:04.173134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:04.173433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:04.184075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:04.185577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:04.200757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:04.201859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:04.202946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 293/609] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:04.209773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561e24c-3ed2-4e96-abbd-7791200f23a0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.309476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:04.340688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.374188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561e24c-3ed2-4e96-abbd-7791200f23a0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:04.431025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:04.431680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:04.431963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:04.432781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:04.433470 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:04.434297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:04.436888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:04.457817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 317/610] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:04.458712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.479015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b6e5b-1f42-4e1a-9cd4-f8ffd24fab42 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:04.525042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:04.526489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:04.526971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:04.527448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:04.540267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:04.547188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:04.548137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:04.548981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:04.551551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 294/611] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:04.552526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.568212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f530c6-f35e-40aa-9bef-808c9ef92be9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:04.576581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:04.592195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:04.615393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:04.616499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:04.617014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:04.617535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:04.629439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:04.635734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:04.636651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:04.637490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:04.640132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 318/612] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:04.641101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.683903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97d00-2092-46e2-823b-e48bcc0c5880 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:04.725427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:04.726425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:04.726914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:04.727433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/bf28e8b35a8246778b66c59164947add/roles/d43a5dcacbf942afad5a4c0cbfb314a2` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:04.742996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=bf28e8b35a8246778b66c59164947add, role_id=d43a5dcacbf942afad5a4c0cbfb314a2)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:04.744722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:04.758365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842815d-82f8-4692-a3b1-b36f729e4bcc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:04.760219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 295/613] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:04 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/bf28e8b35a8246778b66c59164947add/roles/d43a5dcacbf942afad5a4c0cbfb314a2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:04.761360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.839499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:04.845513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:04.845915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:04.846267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:04.846578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:04.847255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:04.847684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:04.849089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:04.869005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 319/614] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:04.874563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:04.889282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea699f8-c81b-4e00-a1f6-8b50a6691787 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:04.925542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:04.972189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:04.972814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:04.973093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:04.973362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:04.974035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:04.974338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:04.975763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:04.994090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 296/615] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:05.004356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412422-86e1-4bde-bff9-ae944269a679 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.004500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.042590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.043219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.043520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.043787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.060454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.062035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:05.080276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:05.081280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:05.082172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:05.082172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:05.082172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:05.082172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 320/616] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:05.088514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.140127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7afd5-5670-4cc9-96a2-f19fc48d567f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.175610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:05.186928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.187779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.188057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.188629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.202374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.202826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526808f7-47c5-4db2-b4f9-4a33307073c9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.203858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:05.206401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:05.222631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:05.223615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:05.224581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:05.224581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:05.224581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:05.224581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 297/617] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:05.229397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.242897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.243544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.243821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.244087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.244727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:05.245122 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.246640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:05.263665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 321/618] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:05.270069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.402911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140a508-2cf8-4ff4-b4dc-bd8223edb6ab None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.449992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.450600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.450873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.451138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.451810 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:05.452107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.453724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:05.487455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 298/619] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:05.491114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586e0f-b313-4ea2-a381-292ca567d7db None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.498413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.544534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.545503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.545774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.546038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.554211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.555674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:05.556136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:05.568457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:05.569626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:05.570553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:05.573262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 322/620] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:05.587845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.603898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:05.631163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ddd45-267b-4f08-89e5-d300bb6c8b98 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.695357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.696016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.696291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.696667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.716955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.718625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:05.720826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0901d8-9a34-42b9-a453-089104a9d606 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:05.738217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:05.740458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:05.742721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:05.748995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 299/621] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:05.760168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.763961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.764561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.764835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.765100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.765818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:05.766115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.768400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:05.792711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 323/622] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:05.798151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:05.935731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95b601-7e5e-46a7-ba3b-279b3b2bbfdf None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:05.936966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:05.945072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:05.985823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:05.985823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:05.985823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:05.985823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:05.986206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:05.986206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:05.986915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:06.007888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 300/623] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:06.016399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.035212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bafb7-285a-4407-af65-2179d2fff5c0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.110094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155001-cbae-4a40-b266-f6a4487ee16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:06.111641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155001-cbae-4a40-b266-f6a4487ee16e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.112078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155001-cbae-4a40-b266-f6a4487ee16e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.112490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155001-cbae-4a40-b266-f6a4487ee16e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.135444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6ac3-b6c8-4c3f-81bf-a5d35e49cdd5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.172112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77363e81-0acd-4569-89a5-7de169920ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:06.173102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363e81-0acd-4569-89a5-7de169920ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.173916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363e81-0acd-4569-89a5-7de169920ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.174188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363e81-0acd-4569-89a5-7de169920ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.184095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77363e81-0acd-4569-89a5-7de169920ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:06.185523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77363e81-0acd-4569-89a5-7de169920ce0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:06.197004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155001-cbae-4a40-b266-f6a4487ee16e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:06.198443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155001-cbae-4a40-b266-f6a4487ee16e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-77363e81-0acd-4569-89a5-7de169920ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:06.200236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:06.201173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 301/624] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317886f3-bfc7-4dc3-9645-9a1addd2e220 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317886f3-bfc7-4dc3-9645-9a1addd2e220 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317886f3-bfc7-4dc3-9645-9a1addd2e220 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 302/625] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:06.209273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1af05-d4a6-4a6a-90ab-a57f97977ef4 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.209898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1af05-d4a6-4a6a-90ab-a57f97977ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.209898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1af05-d4a6-4a6a-90ab-a57f97977ef4 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.209898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 303/626] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:06.209898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1af05-d4a6-4a6a-90ab-a57f97977ef4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.223877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:06.273734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:06.308687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 324/627] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:10:06.310137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451090a5-efbf-49d8-b423-0d1d24f5a138 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.310568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451090a5-efbf-49d8-b423-0d1d24f5a138 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.311010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451090a5-efbf-49d8-b423-0d1d24f5a138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.323600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1af05-d4a6-4a6a-90ab-a57f97977ef4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.329175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-451090a5-efbf-49d8-b423-0d1d24f5a138 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:06.330404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-451090a5-efbf-49d8-b423-0d1d24f5a138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:06.358779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027815b-43f8-4b73-aa7c-ed270b837755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:06.359405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027815b-43f8-4b73-aa7c-ed270b837755 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.359677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027815b-43f8-4b73-aa7c-ed270b837755 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.359942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027815b-43f8-4b73-aa7c-ed270b837755 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.360606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027815b-43f8-4b73-aa7c-ed270b837755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:06.361434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027815b-43f8-4b73-aa7c-ed270b837755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:06.362793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027815b-43f8-4b73-aa7c-ed270b837755 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:06.378990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 304/628] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:06.378990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f326c6-599e-41cc-a860-8e0ef7feeab1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.378990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f326c6-599e-41cc-a860-8e0ef7feeab1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.378990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f326c6-599e-41cc-a860-8e0ef7feeab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.394074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-77f326c6-599e-41cc-a860-8e0ef7feeab1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:06.395235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-77f326c6-599e-41cc-a860-8e0ef7feeab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:06.403790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 325/629] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:06.416353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451090a5-efbf-49d8-b423-0d1d24f5a138 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.475941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:06.483504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 305/630] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:06.484656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f326c6-599e-41cc-a860-8e0ef7feeab1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.561850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:06.571170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451090a5-efbf-49d8-b423-0d1d24f5a138 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.627856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:06.628577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.629070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.629175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.632267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f326c6-599e-41cc-a860-8e0ef7feeab1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.653907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:06.655390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:06.675075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:06.676170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:06.677237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:06.677237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:06.677237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:06.677642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 326/631] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:06.678444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.684097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:06.684733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.685008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.685337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.692525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:06.693961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:06.705221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:06.706111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:06.706991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 306/632] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:06.707512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.792705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b46053-ae48-4947-a27c-0a410915e379 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.795781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:06.823582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc07e3-981c-4c09-81f4-49bc90d6340e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.831695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:06.832613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.833187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.833681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.844602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:06.850435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:06.851366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:06.852252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:06.854848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 327/633] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:06.855914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.862187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:06.862791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:06.863064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:06.863329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:06.864012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:06.864307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:06.865672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:06.873190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:06.879205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 307/634] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:06.880058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:06.976080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a729471-1224-4cba-a4df-f96af39139e8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:06.982329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48469822-0a01-43c5-b86e-2b6c2b78306c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.003913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.012735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.013344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.013623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.013895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.014584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:07.014889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.016341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.019436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.020053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.020331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.020602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.033431 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 328/635] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:07.033431 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.033677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:07.036581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:07.037694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:07.038566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 308/636] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:07.039247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.099052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.128803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8041cd-d0b3-46f8-8219-2cc2f5e3712f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.137805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f3d7-d6f4-4ea0-a879-486841cf0c2e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.163121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737fb4d-f4a1-403a-b8d5-102566368078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.163808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737fb4d-f4a1-403a-b8d5-102566368078 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.164093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737fb4d-f4a1-403a-b8d5-102566368078 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.164368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737fb4d-f4a1-403a-b8d5-102566368078 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.165057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737fb4d-f4a1-403a-b8d5-102566368078 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:07.165360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737fb4d-f4a1-403a-b8d5-102566368078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.166765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737fb4d-f4a1-403a-b8d5-102566368078 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.171493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.172101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.172426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.172696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.174795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 329/637] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:07.175969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bb258-8d9d-4676-9a73-3fc4352caf92 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.176257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bb258-8d9d-4676-9a73-3fc4352caf92 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.176528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bb258-8d9d-4676-9a73-3fc4352caf92 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.179496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 330/638] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:07.179496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bb258-8d9d-4676-9a73-3fc4352caf92 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.182777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.184281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:07.196024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:07.197005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 309/639] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:07.197884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.238028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.282333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bb258-8d9d-4676-9a73-3fc4352caf92 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.295204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed29db-5f66-47c6-bfb2-3dc8582194b3 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.310260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.316073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547499c9-0ab0-454e-b6c9-46cb82d5186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.316726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547499c9-0ab0-454e-b6c9-46cb82d5186c None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.317004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547499c9-0ab0-454e-b6c9-46cb82d5186c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.317278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547499c9-0ab0-454e-b6c9-46cb82d5186c None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/f7aaf3229ccf44718004798534537abc/roles/d43a5dcacbf942afad5a4c0cbfb314a2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.328422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.329010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.329287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.330442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.331108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:07.331438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.331918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547499c9-0ab0-454e-b6c9-46cb82d5186c None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=f7aaf3229ccf44718004798534537abc, role_id=d43a5dcacbf942afad5a4c0cbfb314a2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.332801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.333338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547499c9-0ab0-454e-b6c9-46cb82d5186c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.341144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 310/640] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:07.341725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.350458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 331/641] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:07 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/f7aaf3229ccf44718004798534537abc/roles/d43a5dcacbf942afad5a4c0cbfb314a2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:07.351760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b11c-50ab-4789-9377-d68eba3561ba None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.352040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b11c-50ab-4789-9377-d68eba3561ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.352311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b11c-50ab-4789-9377-d68eba3561ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.375424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7ad1b11c-50ab-4789-9377-d68eba3561ba None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:07.376708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ad1b11c-50ab-4789-9377-d68eba3561ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:07.463717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 332/642] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:07.463717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1b11c-50ab-4789-9377-d68eba3561ba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.463984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253506a-21b8-4976-b773-2187a82b227f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.465760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.504824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.505453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.505726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.505993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.517116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.518558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:07.536657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:07.537726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:07.538613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:07.538613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:07.538613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:07.538613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 311/643] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:07.538935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.590114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1b11c-50ab-4789-9377-d68eba3561ba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.605104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.630767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.631653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.632335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.632771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.633654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:07.634145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.635821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.649098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 333/644] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:07.650136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.678205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5d8eb-00d3-44a6-871b-d0ab764947b7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.724028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.724911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.726225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.726663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.744026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.745713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:07.761268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:07.762384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:07.763651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:07.763651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:07.763651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:07.769969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 312/645] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:07.769969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.773637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a698c8-cd92-44d0-b5e6-de1d1e2a17ca None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.776875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.810243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.810852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.811133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.811430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.812314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:07.812423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.813795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.825988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 334/646] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:07.826700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.860872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:07.881284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380f59a-0290-4d37-aecb-ad4db07008c8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.915263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.915901 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.916176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.916440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:07.917155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=88339d0387834b8b8e833579efd7ee96) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:07.917458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:07.918894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:07.931400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 313/647] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/role_assignments?user.id=88339d0387834b8b8e833579efd7ee96&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:07.931400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:07.946749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612076-b3fc-497d-82ea-c9b7ed3e56aa None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:07.986446 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:07.987202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:07.987516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:07.987794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.007282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:08.012290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:08.013486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:08.014527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:08.018797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 335/648] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:08.019765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.021545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.059711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca8eb7-c702-460f-af39-a2cbaaa7585b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.103239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.104167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.104453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.105108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.105376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:08.105678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.107342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.129228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 314/649] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:08.129228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.139760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.148170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6601a-e18d-46ef-857e-30602839ded1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.197421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.198092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.198370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.198640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.206517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.208047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:08.222310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:08.223285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:10:08.224273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:08.225075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 336/650] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:08.225865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.249856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c07de-2b67-4d9d-a676-6dfdd6b67b88 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.289062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.300266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.300877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.301159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.301426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.302275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:08.302581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.304704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.315991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 315/651] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:08.316933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.351360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146de9a2-740d-448b-afac-d29d065f3d08 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.388648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.389203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.389624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.389915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.400251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.402513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:08.417499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:08.418725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 04:10:08.419991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:08.423448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 337/652] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:08.424436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.440633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78273-ad64-4d59-bcae-dc0ec8c831c2 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.447217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.480855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.481508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.481790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.482060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.482902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:08.483211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.484722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.505605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 316/653] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:08.506427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.565255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.565664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71c1d8-15a2-4e09-809a-d1d09a8552e1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.612095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.614098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.614863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.615402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.623007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629cbc-0e85-4281-aa3f-4644da4f9bb0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.630672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.632742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:08.650367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:08.651329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:08.652914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:08.652914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:08.652914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:08.652914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 338/654] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:08.652914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.672030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.673061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.674114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.674595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.675709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:08.676239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.677923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.702232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 317/655] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:08.702232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.724551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.777473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a458a1-530e-49ed-8b2b-102ab9a09000 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.805709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f91b9-9219-44d6-b177-debffde24807 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:08.815645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.827704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.828314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.828592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.828867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.848315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:08.849467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:08.849970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:08.850491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:08.851468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:08.851993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.853622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.867321 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 318/656] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:08.868629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:08.900830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:08.902164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:08.965176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:08.982144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c37452-0df5-4991-98a9-9258bd434de9 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.015243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 339/657] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:10:09.015969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.030811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.031457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.031740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.032012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.070912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:09.117252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.119966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.124477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc6f5-9b78-4581-b50a-17b6eaba8a25 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.161133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.161802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.162149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.162573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.169909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.171467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:09.183628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:09.186418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 04:10:09.187783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:09.189936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 340/658] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:09.191204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.230705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:09.274602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 319/659] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:10:09.275895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.337090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8b75-d966-4fb7-ae77-baaa03469fd8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.359928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:09.378617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.379589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.380110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.380596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.392706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.394518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.400206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8f67d-a453-4ca3-94ba-33546e79c1db None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:09.410678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:09.411860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:09.412851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:09.412851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:09.412851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:09.419240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 341/660] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:09.420458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.437996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.438620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.439514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.439792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.440518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:09.440814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.442405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.462944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 320/661] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:09.463819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.507304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:09.533917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ab4d9-e517-4cbd-a166-cb0558e43abe None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.562195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5789cb-fa13-4873-b45c-8467711ccae4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.569405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6727b-5967-41d8-8102-081f4a26659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.570159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6727b-5967-41d8-8102-081f4a26659d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.570439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6727b-5967-41d8-8102-081f4a26659d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.570711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6727b-5967-41d8-8102-081f4a26659d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.582788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6727b-5967-41d8-8102-081f4a26659d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.584257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6727b-5967-41d8-8102-081f4a26659d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.588193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:09.599353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.599977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.600252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-50d6727b-5967-41d8-8102-081f4a26659d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:09.600362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:09.601220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:09.602113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:09.602113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:09.602113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:09.602283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.602283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:09.602903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 342/662] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:09.602903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800d7e2-f347-43c5-9ae7-82098f6f97af None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.602903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800d7e2-f347-43c5-9ae7-82098f6f97af None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.603132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800d7e2-f347-43c5-9ae7-82098f6f97af None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.604561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 343/663] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:09.606130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.607588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.609088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800d7e2-f347-43c5-9ae7-82098f6f97af None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.620073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 321/664] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:09.621092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.720441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800d7e2-f347-43c5-9ae7-82098f6f97af None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.732376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9910896-386f-47b4-a753-0870ee2e4958 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:09.747920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:09.757822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.758438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.758720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.758994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.771504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9933a-21ac-4a57-a349-d59b2f7d0d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:09.772118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9933a-21ac-4a57-a349-d59b2f7d0d75 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.772408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9933a-21ac-4a57-a349-d59b2f7d0d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.772672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9933a-21ac-4a57-a349-d59b2f7d0d75 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.773313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9933a-21ac-4a57-a349-d59b2f7d0d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:09.773637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9933a-21ac-4a57-a349-d59b2f7d0d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.774982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9933a-21ac-4a57-a349-d59b2f7d0d75 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.791914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 322/665] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:09.791914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937595f8-ed22-4811-9eb4-f1a6a1258128 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:09.791914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937595f8-ed22-4811-9eb4-f1a6a1258128 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:09.791914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937595f8-ed22-4811-9eb4-f1a6a1258128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:09.807589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-937595f8-ed22-4811-9eb4-f1a6a1258128 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:09.808798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-937595f8-ed22-4811-9eb4-f1a6a1258128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:09.837095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:09.838543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:09.852691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:09.883342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 323/666] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:09.884539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937595f8-ed22-4811-9eb4-f1a6a1258128 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:09.965406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 344/667] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:10:09.967092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.006118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.026094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937595f8-ed22-4811-9eb4-f1a6a1258128 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.073300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.073942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.074220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.074493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.082326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.083997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.084381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6f4c-9fe4-4a82-9a37-9f2560986fdf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:10.095096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:10.096773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 324/668] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:10.098417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.124763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e7e69-b561-4a04-8dd0-970b97595588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.125485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7e69-b561-4a04-8dd0-970b97595588 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.125767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7e69-b561-4a04-8dd0-970b97595588 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.126039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7e69-b561-4a04-8dd0-970b97595588 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.132969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e7e69-b561-4a04-8dd0-970b97595588 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.134515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e7e69-b561-4a04-8dd0-970b97595588 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.136643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-988e7e69-b561-4a04-8dd0-970b97595588 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:10.148529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:10.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:10.150352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 345/669] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:10.151463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76b9f-9636-4c91-9f32-d024216faa81 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.151463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76b9f-9636-4c91-9f32-d024216faa81 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.151463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76b9f-9636-4c91-9f32-d024216faa81 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.152815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 346/670] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:10.153422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f76b9f-9636-4c91-9f32-d024216faa81 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.213393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80b7c-ffba-46e9-88ec-51f9f10e39a8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.240335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.246436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.247065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.247343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.247646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.254273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f76b9f-9636-4c91-9f32-d024216faa81 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.258306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.259789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:10.274616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:10.275699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:10.276654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:10.276654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:10.276654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:10.276654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 325/671] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:10.276928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.291162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085dab4-0fef-4ae7-baf4-2bade27a13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.291796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085dab4-0fef-4ae7-baf4-2bade27a13a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.292073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085dab4-0fef-4ae7-baf4-2bade27a13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.292343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085dab4-0fef-4ae7-baf4-2bade27a13a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.293029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085dab4-0fef-4ae7-baf4-2bade27a13a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:10.293334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085dab4-0fef-4ae7-baf4-2bade27a13a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.294750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085dab4-0fef-4ae7-baf4-2bade27a13a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.306270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 347/672] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:10.307588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee5f7e-0033-4b6a-892f-ee194a7a47c7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.307875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee5f7e-0033-4b6a-892f-ee194a7a47c7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.308149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee5f7e-0033-4b6a-892f-ee194a7a47c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.325722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-14ee5f7e-0033-4b6a-892f-ee194a7a47c7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:10.326918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-14ee5f7e-0033-4b6a-892f-ee194a7a47c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:10.367853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.380756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49d74-5c36-46ac-8b62-887a155acfe4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.391501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 348/673] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:10.392894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee5f7e-0033-4b6a-892f-ee194a7a47c7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.419404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.420012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.420293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.420564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.421253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:10.421558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.422997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.440107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 326/674] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:10.440107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.479404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.503698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee5f7e-0033-4b6a-892f-ee194a7a47c7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.541764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.541938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f37d5d-fab3-41ce-b301-17a7f83414a6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.542748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.543212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.543709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.554496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:10.559520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:10.560466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:10.561314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:10.563746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 349/675] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:10.565202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.580875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.581483 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.581784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.582062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.582708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:10.583018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.584419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.600397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 327/676] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:10.600397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.607987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.681053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d32476-249d-4ec2-bcf2-0f95ba544ae9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.707337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ad164-cc1c-4e86-9c5e-26f876d7a229 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.715001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.715630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.715907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.716178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.716894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=fa181d21ba124c4ba2efd96ddecf5f06) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:10.717199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.718627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.724401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 350/677] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/role_assignments?user.id=fa181d21ba124c4ba2efd96ddecf5f06&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:10.725108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.727533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.750796 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.752065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.752294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.752562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.753298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=6b07846b067c4073b5701db6e9232d0b) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:10.753602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.755315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.775460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 328/678] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/role_assignments?user.id=6b07846b067c4073b5701db6e9232d0b&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:10.775460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.868514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a699c-1b24-46bf-a9a6-ead3cf5c77e0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.869309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:10.914740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e20e53-f517-4bff-a3d7-00fc4b2b5c91 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:10.914975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.914975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.914975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.914975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.915506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:10.917164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.917164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:10.930248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 351/679] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:10.931820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:10.973740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:10.974542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:10.974913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:10.975141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:10.987982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:10.988180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:11.002753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:11.003700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:11.004603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 329/680] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:11.005100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.027121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:11.083068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd673fa-8f61-4e7a-b2ab-7e67692b9a86 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.118472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593952-c271-406c-b1a1-79ea0133e29c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.120073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.120967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.121464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.121938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.133238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:11.138870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:11.139850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:11.140708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:11.147900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 352/681] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:11.149016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.153207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.154214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.154214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.154408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.156970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:11.168036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.169817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:11.188725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:11.189758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:11.190651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:11.190651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:11.190651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:11.195400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 330/682] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:11.196333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.265798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd12aa-9959-4ec3-8c90-2a5cc7cc3936 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.297012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:11.307534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7b44-8238-4c70-9e11-aaa2f215630d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.313502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.314944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.315466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.316441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.317365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:11.317901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.320628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.338109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 353/683] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:11.339832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.349198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.350624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.350786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.351338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.352163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:11.352632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.354158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.369587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 331/684] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:11.369587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.417599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:11.480303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180d87-4399-41f0-9e17-c2bfa4b1ec4e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.480535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829101-4f21-4f20-b5c5-b37160fe4839 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.517618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.518308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.518735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.519052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.519439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.519545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.519838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.520159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.520682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=bf28e8b35a8246778b66c59164947add) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:11.521049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.521369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:11.521851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.522781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.523599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.529406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 332/685] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/role_assignments?user.id=bf28e8b35a8246778b66c59164947add&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:11.530425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.536588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 354/686] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:11.549963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.647681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ab2c-76c3-4ea2-95e0-d74f2cff2bcb None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.661003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:11.678590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:11.687771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.688410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.688708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.689496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.701560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.703040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:11.718542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:11.719595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:11.721068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:11.721068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:11.721068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:11.721068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 333/687] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:11.727188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.783699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9ae40-722a-4474-90af-0aefb5209f49 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.821455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.822089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.822367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.822638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.834956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.836508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:11.849138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:11.851018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:11.852118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 355/688] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:11.856790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222770-f907-4365-9995-c2b617cfccfb None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:11.864358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.897875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:11.898837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:11.899338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:11.899851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:11.900812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:11.901387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:11.903002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:11.917906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 334/689] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:11.924178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:11.956793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:12.010986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527553-bb11-4f8a-84e6-3d243eafc73f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:12.013524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:12.048123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:12.048821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.049101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.049373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.050217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:12.050745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:12.052540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:12.059608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e817-939b-4893-92a5-eb09c515a819 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:12.094820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 356/690] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:12.096032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:12.102003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:12.102932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.103447 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.104066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.124150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:12.129036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:12.150260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:12.151226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:12.152201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:12.158387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 335/691] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:10:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:12.161395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:12.279053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e713d2-d2a8-42cd-97c8-2589d54dc31a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:12.283875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:12.304024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a29585-c055-41f0-9be3-20fe61aecfd1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:12.339231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:12.339874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.340153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.340430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.341156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:12.341460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:12.342894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:12.356143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:12.356767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.357048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.357340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.363073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 336/692] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:10:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:12.381654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:12.411520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:12.480529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:12.482014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:12.568144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b6549-ce5f-4786-8446-0d687a013bdc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:12.632908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63eee-18d1-47ac-b0c4-d898dae3d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:12.633558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63eee-18d1-47ac-b0c4-d898dae3d819 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.633837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63eee-18d1-47ac-b0c4-d898dae3d819 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.634109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63eee-18d1-47ac-b0c4-d898dae3d819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.648872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:12.690604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 357/693] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 04:10:12.696344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:12.724692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63eee-18d1-47ac-b0c4-d898dae3d819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:12.725893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63eee-18d1-47ac-b0c4-d898dae3d819 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:12.797403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:12.839797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8531-8d74-4c27-9450-8bc00b2ef07b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:12.917738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 337/694] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 04:10:12.923828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bf7c8-a0f2-45d3-9d94-e7ea5267924d None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.924081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586686-1a77-4a6a-9918-2876ec736e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:12.924260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bf7c8-a0f2-45d3-9d94-e7ea5267924d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.924609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bf7c8-a0f2-45d3-9d94-e7ea5267924d None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.924730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586686-1a77-4a6a-9918-2876ec736e37 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.925010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586686-1a77-4a6a-9918-2876ec736e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.925280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586686-1a77-4a6a-9918-2876ec736e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.926553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 338/695] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:12.927090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bf7c8-a0f2-45d3-9d94-e7ea5267924d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:12.941282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85586686-1a77-4a6a-9918-2876ec736e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:12.942748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85586686-1a77-4a6a-9918-2876ec736e37 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-85586686-1a77-4a6a-9918-2876ec736e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:12.957282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:12.958443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:12.959344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:12.959344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:12.959344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:12.959344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 358/696] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:12.959902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667636-fb4e-4e04-9139-fb637e8bdc8f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:12.960181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667636-fb4e-4e04-9139-fb637e8bdc8f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:12.960451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667636-fb4e-4e04-9139-fb637e8bdc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:12.978632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-67667636-fb4e-4e04-9139-fb637e8bdc8f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:12.978800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:12.979848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-67667636-fb4e-4e04-9139-fb637e8bdc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:13.049485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bf7c8-a0f2-45d3-9d94-e7ea5267924d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.054136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 359/697] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:13.055511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9d1c-6c20-4144-8a2e-f3e148e8afe6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.056370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9d1c-6c20-4144-8a2e-f3e148e8afe6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.057192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9d1c-6c20-4144-8a2e-f3e148e8afe6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.059145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 360/698] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:13.063830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c9d1c-6c20-4144-8a2e-f3e148e8afe6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.102113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49fc47-7066-43ce-88d0-c4e2ffba1d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.103108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49fc47-7066-43ce-88d0-c4e2ffba1d3e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.103641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49fc47-7066-43ce-88d0-c4e2ffba1d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.104119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49fc47-7066-43ce-88d0-c4e2ffba1d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.117567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49fc47-7066-43ce-88d0-c4e2ffba1d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.119325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49fc47-7066-43ce-88d0-c4e2ffba1d3e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.119773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2f49fc47-7066-43ce-88d0-c4e2ffba1d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:13.140669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:13.141905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:13.143592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:13.143592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:13.143592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:13.151016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 339/699] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:13.152929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2212f-4d97-4891-a21c-909768ef599f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.153361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2212f-4d97-4891-a21c-909768ef599f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.153799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2212f-4d97-4891-a21c-909768ef599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.179711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1da2212f-4d97-4891-a21c-909768ef599f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:13.180530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c9d1c-6c20-4144-8a2e-f3e148e8afe6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.181581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1da2212f-4d97-4891-a21c-909768ef599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:13.220077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.221081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.221464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.222249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.223292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:13.223726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.225456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.243518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 361/700] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:13.244552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.275396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 340/701] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:13.275396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2212f-4d97-4891-a21c-909768ef599f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.295741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:13.388002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2212f-4d97-4891-a21c-909768ef599f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.396668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626c304-e3ca-46b1-bced-46dfcf0ab51d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.399706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:13.433343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.434104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.434472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.434757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.438562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.439857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.440235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.440604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.441344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:13.442022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.442541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.443692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.444018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.457292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 362/702] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:13.457975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:13.459018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:13.460201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:13.460723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.463873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 341/703] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:13.465071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.572424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:13.585213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22010-679d-4698-881c-4a6d848c34f5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.595148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e6557-bafd-47f3-87ef-06d796b7392c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.627440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.628384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.628907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.629326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.629821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.630249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.630424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.630706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.630974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.631702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:13.632540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.632848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.633975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.646473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 342/704] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:13.646820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:13.647840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:13.648727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:13.649470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.651050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 363/705] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:13.652299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.684654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:13.752799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2486a-47e0-4ed1-b1f4-e7a06d005a18 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.763801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f65f2e-098c-45d2-ab04-1a8d36439c97 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.786550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.787183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.787488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.787761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.794516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.796001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.802115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.803236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.803708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.804125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:13.807539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:13.808613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:13.809513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 343/706] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:13.810003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.816152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:13.820278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.821917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:13.838536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:13.839746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:13.840839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:13.840839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:13.840839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:13.842257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 364/707] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:13.843166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:13.926466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524999a6-78d2-48a8-9f1c-bf943b8d4159 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.935305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:13.957644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6874f-b39c-4480-86b4-cca6f05af73e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:13.962804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:13.963442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:13.963747 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:13.964021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:13.964651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:13.964950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:13.966323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:13.971929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 344/708] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:13.972544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:14.004621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:14.005253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.005529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.005795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.006522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=f7aaf3229ccf44718004798534537abc) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:14.006826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:14.008553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:14.014672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 365/709] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/role_assignments?user.id=f7aaf3229ccf44718004798534537abc&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:14.015546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:14.047063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:14.089012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc7a5-b05f-4b29-b0a7-5a465a046ebc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:14.129751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:14.130373 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.130650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.130919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.131651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:14.132212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:14.133670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:14.135395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5154a52-d57a-432a-8081-44412e450510 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:14.147574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 345/710] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:14.148758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:14.184296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9e25f-3952-4d30-86fb-c73a19e6dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:14.185139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e25f-3952-4d30-86fb-c73a19e6dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.185418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e25f-3952-4d30-86fb-c73a19e6dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.185692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e25f-3952-4d30-86fb-c73a19e6dbc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.186341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9e25f-3952-4d30-86fb-c73a19e6dbc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:14.186645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9e25f-3952-4d30-86fb-c73a19e6dbc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:14.188059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9e25f-3952-4d30-86fb-c73a19e6dbc2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:14.201879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 366/711] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:14.203116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bb525-9d64-45a2-800b-ed9b583ab8e7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.204121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bb525-9d64-45a2-800b-ed9b583ab8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.204121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bb525-9d64-45a2-800b-ed9b583ab8e7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.207824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 367/712] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:14.207824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bb525-9d64-45a2-800b-ed9b583ab8e7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:14.211980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:14.267871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104477b-2ffe-4870-982f-9594bbb387be None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:14.294686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:14.306866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:14.307501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.307779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.308046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.308671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:14.308969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:14.310328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:14.319579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 346/713] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Sep 6 04:10:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:14.319579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:14.328789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bb525-9d64-45a2-800b-ed9b583ab8e7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:14.370843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2332c-43dc-41a4-939d-7c86c40ea0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:14.371505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2332c-43dc-41a4-939d-7c86c40ea0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.371782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2332c-43dc-41a4-939d-7c86c40ea0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.372055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2332c-43dc-41a4-939d-7c86c40ea0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.372801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2332c-43dc-41a4-939d-7c86c40ea0c3 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=88339d0387834b8b8e833579efd7ee96) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:14.373174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2332c-43dc-41a4-939d-7c86c40ea0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:14.375560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2332c-43dc-41a4-939d-7c86c40ea0c3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:14.387405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 368/714] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:14 2022] GET /identity/v3/role_assignments?user.id=88339d0387834b8b8e833579efd7ee96&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:14.387405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959d44-9535-4388-936e-2b539aeb9932 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.387405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959d44-9535-4388-936e-2b539aeb9932 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.387405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959d44-9535-4388-936e-2b539aeb9932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.425424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f5959d44-9535-4388-936e-2b539aeb9932 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:14.426245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f5959d44-9535-4388-936e-2b539aeb9932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:14.470291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb49e1-8024-47f9-86a5-e348431b609e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:14.525163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:14.525842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.526267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.526603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.527427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:14.529041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:14.535457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:14.536218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 369/715] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:14.556390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 347/716] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:10:14 2022] POST /identity/v3/users => generated 254 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:14.815151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959d44-9535-4388-936e-2b539aeb9932 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:14.918986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959d44-9535-4388-936e-2b539aeb9932 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:14.954518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:14.955150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:14.955444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:14.955713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] PATH_INFO: `/v3/services/network` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:14.956301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:14.957655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:14.967123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:14.968116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:14.968931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:14.971931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 370/717] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:14 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:14.975922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:15.028085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:15.089762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b494-8f1b-40ea-8ce7-65b5455f7adc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:15.126005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f372f88-5adc-4073-b4bc-136e29085d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:15.126670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f372f88-5adc-4073-b4bc-136e29085d35 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:15.126942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f372f88-5adc-4073-b4bc-136e29085d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:15.127208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f372f88-5adc-4073-b4bc-136e29085d35 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:15.127869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f372f88-5adc-4073-b4bc-136e29085d35 None admin] RBAC: Adding query filter params (name=network) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:15.128169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f372f88-5adc-4073-b4bc-136e29085d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:15.129532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f372f88-5adc-4073-b4bc-136e29085d35 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:15.139487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 348/718] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:15.141171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:15.228537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:15.268352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c039f-a08b-464c-a93b-d26a0fbe2a1f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:15.319121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103ba09-f8e1-4836-9e7c-95cd31d983ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:15.319764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103ba09-f8e1-4836-9e7c-95cd31d983ce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:15.320042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103ba09-f8e1-4836-9e7c-95cd31d983ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:15.320370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103ba09-f8e1-4836-9e7c-95cd31d983ce None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:15.321012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103ba09-f8e1-4836-9e7c-95cd31d983ce None admin] RBAC: Adding query filter params (type=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:15.321313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103ba09-f8e1-4836-9e7c-95cd31d983ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:15.322728 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103ba09-f8e1-4836-9e7c-95cd31d983ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:15.333965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 371/719] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:16.210546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f596-4813-4899-a275-717df34e185c None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:16.211092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f596-4813-4899-a275-717df34e185c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:16.211092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f596-4813-4899-a275-717df34e185c None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:16.212719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 349/720] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:16.217645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa26d0-f5e6-4b80-b71c-3d660099670b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:16.218067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa26d0-f5e6-4b80-b71c-3d660099670b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:16.218243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa26d0-f5e6-4b80-b71c-3d660099670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:16.239785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f4aa26d0-f5e6-4b80-b71c-3d660099670b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:16.241073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f4aa26d0-f5e6-4b80-b71c-3d660099670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:16.331330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 372/721] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:16.589733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7352-8a5e-40d6-a10c-8122f558895a None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:16.590088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7352-8a5e-40d6-a10c-8122f558895a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:16.590293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7352-8a5e-40d6-a10c-8122f558895a None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:16.591888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 350/722] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:16.597730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590e35-c767-4c5e-a69b-d21b30141a8e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:16.598020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590e35-c767-4c5e-a69b-d21b30141a8e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:16.598295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590e35-c767-4c5e-a69b-d21b30141a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:16.624296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c6590e35-c767-4c5e-a69b-d21b30141a8e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:16.625495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6590e35-c767-4c5e-a69b-d21b30141a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:16.693692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:16.715033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 373/723] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:16.746612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1825-3c51-4277-8972-7ac94e7f4c86 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:16.746911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1825-3c51-4277-8972-7ac94e7f4c86 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:16.747170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1825-3c51-4277-8972-7ac94e7f4c86 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:16.748705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 351/724] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:16.753676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fc9e-1701-4b19-b03f-b69ddf2e8afc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:16.753966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fc9e-1701-4b19-b03f-b69ddf2e8afc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:16.754242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fc9e-1701-4b19-b03f-b69ddf2e8afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:16.777472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-33f7fc9e-1701-4b19-b03f-b69ddf2e8afc None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:16.778673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-33f7fc9e-1701-4b19-b03f-b69ddf2e8afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:16.822205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1825-3c51-4277-8972-7ac94e7f4c86 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:16.873188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 374/725] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:16.993042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1825-3c51-4277-8972-7ac94e7f4c86 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:17.013428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:17.049053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:17.049687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:17.050014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:17.050289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:17.063093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:17.068516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:17.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:17.070358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:17.072805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 352/726] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:17.084507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fc9e-1701-4b19-b03f-b69ddf2e8afc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:17.146530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:17.294274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fc9e-1701-4b19-b03f-b69ddf2e8afc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:17.324862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:17.327153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059094-10df-4568-9189-cb75a56d95a7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:17.346417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:17.347038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:17.347328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:17.347636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:17.348308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:17.348611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:17.350064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:17.359423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 375/727] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:17.359735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:17.373719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:17.374338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:17.374619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:17.374893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:17.375828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:17.377906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:17.400633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 353/728] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:17 2022] POST /identity/v3/services => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:10:17.400633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:17.471651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:17.526981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f9e23-d928-4b5a-9479-ebabc33a997a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:17.620425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36bda-904d-462d-a43c-82e197a24f63 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:17.675749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995641c0-557a-4857-a84d-5bc7c6855412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:17.676775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995641c0-557a-4857-a84d-5bc7c6855412 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:17.677259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995641c0-557a-4857-a84d-5bc7c6855412 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:17.677748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995641c0-557a-4857-a84d-5bc7c6855412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:17.690766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995641c0-557a-4857-a84d-5bc7c6855412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:17.692895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995641c0-557a-4857-a84d-5bc7c6855412 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-995641c0-557a-4857-a84d-5bc7c6855412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:17.717613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:17.718680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:17.719617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:17.719617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:17.719617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:17.722250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 354/729] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:17.723770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf7c2-ee7a-4a53-acd8-588a03ded6e3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:17.724363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf7c2-ee7a-4a53-acd8-588a03ded6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:17.724844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf7c2-ee7a-4a53-acd8-588a03ded6e3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:17.731652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 355/730] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:17.732915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf7c2-ee7a-4a53-acd8-588a03ded6e3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:17.737604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78e48c-e29e-4ea9-9636-9d1f12138689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:17.738250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78e48c-e29e-4ea9-9636-9d1f12138689 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:17.738528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78e48c-e29e-4ea9-9636-9d1f12138689 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:17.738796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78e48c-e29e-4ea9-9636-9d1f12138689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:17.756109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78e48c-e29e-4ea9-9636-9d1f12138689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ac78e48c-e29e-4ea9-9636-9d1f12138689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:17.763366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:17.764430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:17.765297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:17.775328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 376/731] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:17.777174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea58a-8f7d-4e45-8370-6c33b67ec103 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:17.777973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea58a-8f7d-4e45-8370-6c33b67ec103 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:17.778470 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea58a-8f7d-4e45-8370-6c33b67ec103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:17.804177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-94aea58a-8f7d-4e45-8370-6c33b67ec103 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:17.807130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-94aea58a-8f7d-4e45-8370-6c33b67ec103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:17.867405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:17.918973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 377/732] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 04:10:17.920289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea58a-8f7d-4e45-8370-6c33b67ec103 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:17.987784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:17.997676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf7c2-ee7a-4a53-acd8-588a03ded6e3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.038104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6aca3-1886-4b2b-9dc0-0020fcd0a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.039072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6aca3-1886-4b2b-9dc0-0020fcd0a34e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.039597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6aca3-1886-4b2b-9dc0-0020fcd0a34e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.040147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6aca3-1886-4b2b-9dc0-0020fcd0a34e None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.040996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6aca3-1886-4b2b-9dc0-0020fcd0a34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:18.041494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6aca3-1886-4b2b-9dc0-0020fcd0a34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.043058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6aca3-1886-4b2b-9dc0-0020fcd0a34e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.047955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea58a-8f7d-4e45-8370-6c33b67ec103 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.055309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 356/733] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:18.056978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c50c-6086-4000-a386-535077512a16 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.057479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c50c-6086-4000-a386-535077512a16 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.057962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c50c-6086-4000-a386-535077512a16 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.059657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 357/734] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:18.065716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a19049-9198-41f5-8927-931b6f633acf None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.066539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a19049-9198-41f5-8927-931b6f633acf None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.067319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a19049-9198-41f5-8927-931b6f633acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.093783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f0a19049-9198-41f5-8927-931b6f633acf None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:18.093982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.094593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.095100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.095566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.095928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f0a19049-9198-41f5-8927-931b6f633acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:18.096717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:18.097195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.098803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.108092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 378/735] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:18.109143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.139429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:18.187361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 358/736] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 04:10:18.188617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a19049-9198-41f5-8927-931b6f633acf None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.229731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353cf6-f952-46f9-af1b-3b54d0fd9515 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.273666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.274448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.274790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.275483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.280494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:18.286327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.287890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:18.303609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:18.305220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 379/737] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:18.306152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.324882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a19049-9198-41f5-8927-931b6f633acf None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.362157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.363025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.363446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.363913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.375398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.377526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:18.393971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:18.395989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:18.398084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:18.398084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:18.398084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:18.398084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 359/738] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:18.398084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.422727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:18.440176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08f99f-1d0f-47fe-829b-bd2579790493 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.478594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.479330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.479661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.480041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.491356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:18.496674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:18.499070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 380/739] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:18.501603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.523855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63aa6cb-bbf5-4638-8217-62748fb01d0c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.544729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:18.560387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.561177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.561607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.561879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.562606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:18.562909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.564387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.584619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 360/740] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:18.585502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.608161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37283f4f-1a89-402e-bc48-b4bacda8f2b8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.645622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.646516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.647000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.647532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.648353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:18.648850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.650389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.663402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 381/741] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:18.664441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.674743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:18.699008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c75ab-a7d8-4392-a7f4-dc21cca23d7c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.736363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.736959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.737233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.737497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.738135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.739516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.758073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 361/742] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:18 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:18.758686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.776497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a217-c0a9-4fa1-9d26-f1689ff4b0e7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.807954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:18.824696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.825655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.826123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.826964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.827917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:18.828412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:18.831097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:18.840928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 382/743] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:18.847427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:18.879678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff192071-39cc-452e-8c09-8b5d0a08150f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:18.918701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:18.918911 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:18.919494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:18.919845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:18.920124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:18.972107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16ea5-1986-4a08-a4ad-d8cf32f525a5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.015533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.017686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.019705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.021541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.022006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.022424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.033423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.035840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:19.052297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:19.053474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:19.054652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:19.062062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 383/744] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:19.062062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.068342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:19.150196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 362/745] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:19.151464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.179682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9de8-8836-4fd7-a1c8-bcdd488be197 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.206563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:19.219450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.220644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.221010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.221280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.232767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.234405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:19.250726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:19.251790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:19.252771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:19.252771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:19.252771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:19.255631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 384/746] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:19.256594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.270849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda393-949d-4d46-96fe-bd434f5bce1b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.309983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.310925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.311522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.312027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.313014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:19.313640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.315434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.324295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:19.339716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 363/747] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:19.340990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.369508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0c3a-90f2-4010-ae9c-1625871b5f5d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.409850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.410854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.411384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.411939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.424070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.425844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:19.440931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:19.441983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:19.442867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:19.442867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:19.442867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:19.444672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 385/748] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:19.446094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.462946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d01cfc-8660-4405-a284-fd1226af7cdc None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.478800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:19.502692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893c10f-866a-4b4b-b9c0-b8f50d3de98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.503293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c10f-866a-4b4b-b9c0-b8f50d3de98e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.503818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c10f-866a-4b4b-b9c0-b8f50d3de98e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.503927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c10f-866a-4b4b-b9c0-b8f50d3de98e None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.504497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c10f-866a-4b4b-b9c0-b8f50d3de98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:19.504793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c10f-866a-4b4b-b9c0-b8f50d3de98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.506212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c10f-866a-4b4b-b9c0-b8f50d3de98e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.517745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 364/749] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:19.521218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d508d0-7dba-45b9-b016-edb804b94c72 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.521963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d508d0-7dba-45b9-b016-edb804b94c72 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.522441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d508d0-7dba-45b9-b016-edb804b94c72 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.523960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 365/750] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:19.524886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d508d0-7dba-45b9-b016-edb804b94c72 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.561031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dbc9a-fc4c-4057-92c2-4e19df1fb575 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.593602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:19.596440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.597285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.597691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.598063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.609666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.611147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:19.625152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:19.631307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:19.632759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:19.632759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:19.632759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:19.632759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 386/751] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:19.632759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.647808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d508d0-7dba-45b9-b016-edb804b94c72 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.684329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b710cb0-f94d-4c89-90f1-ec974eb26fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.685183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710cb0-f94d-4c89-90f1-ec974eb26fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.685616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710cb0-f94d-4c89-90f1-ec974eb26fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.686057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710cb0-f94d-4c89-90f1-ec974eb26fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.686845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b710cb0-f94d-4c89-90f1-ec974eb26fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:19.687336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b710cb0-f94d-4c89-90f1-ec974eb26fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.689028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b710cb0-f94d-4c89-90f1-ec974eb26fe3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.700868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 366/752] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:19.702319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c58e-bbb8-4c76-97d3-493912ca388c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.702602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c58e-bbb8-4c76-97d3-493912ca388c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.702870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c58e-bbb8-4c76-97d3-493912ca388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.720642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:19.722855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0b49c58e-bbb8-4c76-97d3-493912ca388c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:19.724084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0b49c58e-bbb8-4c76-97d3-493912ca388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:19.741013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4588-20ab-4c82-9e4d-deb1f2684282 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.776288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.776926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.777199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.777465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.786382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.788295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.802579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 367/753] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:19.802579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49c58e-bbb8-4c76-97d3-493912ca388c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:19.802837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:19.803927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 387/754] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:19.805046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.849024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:19.912479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49c58e-bbb8-4c76-97d3-493912ca388c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.931550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e71a6-8a80-4c5d-995e-9c6c34f6ff68 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:19.952040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.952828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.953341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.953752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:19.955099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:19.955600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:19.957231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:19.969816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 368/755] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:19.970878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:19.990452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:19.991171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:19.991557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:19.992145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.004842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.006488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.009578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:20.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:20.021735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:20.022823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:20.028377 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 388/756] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:20.029309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.094146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705294ad-3222-4098-9ffc-41ca592d9c24 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.101976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.137699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.138646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.139105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.139636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.140054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcc4e0-2703-4820-8a6f-40b30be9373b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.140821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:20.141302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.143527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.165026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 369/757] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Sep 6 04:10:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:20.165026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.180006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.180628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.180926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.181171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.187837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.189787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:20.200716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:20.201586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:20.202476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 389/758] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:20.203171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.265610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.273428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f88e9-d502-4ae6-93fc-86e4df9928c4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.307813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.308410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.308684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.308978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.309665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:20.309963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.311404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.315270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dcdf2-5e5e-4719-9cf9-87e467003743 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.328067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 370/759] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:20.328067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.354497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.355756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.356552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.356973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.357420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.358390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.360011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:20.369716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:20.371210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:20.372271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:20.379013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 390/760] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:20.379013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.436176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b615228-dca1-46de-809c-666e46563b1a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.471892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.472593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.472938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.473221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.484787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8a665-d52d-432f-9fde-327ab06e2fee None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.510415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.522379 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.522981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.523270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.523568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.524306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:20.524618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.526297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.543581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 391/761] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:20.543581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.547331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.549420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.573477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.647108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3986b8-fccc-4e99-8e0f-6d9762b64a79 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.655087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 371/762] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:20.655087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.689804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.690398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.690668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.690927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.691680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=f7aaf3229ccf44718004798534537abc) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:20.692054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.693821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.698987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 392/763] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/role_assignments?user.id=f7aaf3229ccf44718004798534537abc&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:20.707726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.763114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.785878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ad969-4b7a-4da8-a585-5ea5b1f0d2ae None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.812479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:20.821851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a7603-378a-48cb-98f7-08db705cec29 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:20.826666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.827330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.827655 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.827928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.828562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:20.828862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.830292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.839893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 372/764] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:20.839893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.867477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3d8b8-e02a-4a99-95ef-92d4a9b04e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:20.868141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3d8b8-e02a-4a99-95ef-92d4a9b04e31 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.868418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3d8b8-e02a-4a99-95ef-92d4a9b04e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.868685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3d8b8-e02a-4a99-95ef-92d4a9b04e31 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/88339d0387834b8b8e833579efd7ee96/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.870577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3d8b8-e02a-4a99-95ef-92d4a9b04e31 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=88339d0387834b8b8e833579efd7ee96, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:20.872025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3d8b8-e02a-4a99-95ef-92d4a9b04e31 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:20.886243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 393/765] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:20 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/88339d0387834b8b8e833579efd7ee96/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:20.887493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84d941-ff8d-433a-ae46-76bd581616d3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:20.887777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84d941-ff8d-433a-ae46-76bd581616d3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:20.888047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84d941-ff8d-433a-ae46-76bd581616d3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:20.889451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 394/766] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:20.894279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84d941-ff8d-433a-ae46-76bd581616d3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:20.986710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7f33d-ddaf-4bc6-8599-d11172992a19 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.030618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84d941-ff8d-433a-ae46-76bd581616d3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.035236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d20162-50c2-4732-b999-6890975993e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.036043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20162-50c2-4732-b999-6890975993e1 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.036423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20162-50c2-4732-b999-6890975993e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.036797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20162-50c2-4732-b999-6890975993e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.044590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:21.054062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d20162-50c2-4732-b999-6890975993e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.056111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d20162-50c2-4732-b999-6890975993e1 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-61d20162-50c2-4732-b999-6890975993e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:21.075825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:21.076869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:21.077776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:21.077776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:21.077776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:21.079233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 373/767] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:21.081167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbef72-d7cd-4712-9edf-08c4be86f7fe None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.081687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbef72-d7cd-4712-9edf-08c4be86f7fe None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.082172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbef72-d7cd-4712-9edf-08c4be86f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.083030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.083670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.084354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.084626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.085345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:21.085657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.087023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.092991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 395/768] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Sep 6 04:10:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:21.094002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.103130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3dcbef72-d7cd-4712-9edf-08c4be86f7fe None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:21.104528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3dcbef72-d7cd-4712-9edf-08c4be86f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:21.144565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:21.186139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 374/769] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:21.187061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbef72-d7cd-4712-9edf-08c4be86f7fe None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.201693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09951c-fa9f-4e4a-9192-edc2372ecd8d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.275735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.276587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.277034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.277565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.278472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:21.278780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.284277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.298330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbef72-d7cd-4712-9edf-08c4be86f7fe None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.307096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 396/770] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:21.312090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.336500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.337851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.338460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.338952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.340029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] RBAC: Adding query filter params (interface=public, service_id=c9af069f7bcc43c88af188758259d257, region_id=RegionOne) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:21.340534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.342089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.352579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 375/771] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/endpoints?service_id=c9af069f7bcc43c88af188758259d257&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:21.357840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.372001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:21.425301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:21.512987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d6264-b139-47c8-8ec8-f54d9fd59d53 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.557076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb311e79-b1b2-443d-87eb-f393c4b01986 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.562957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.564374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.564856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.565444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.572639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.574149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:21.587487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:21.588394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:21.589295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 397/772] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:21.589774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.598733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.599632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.600100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.600541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.601319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.602868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.610460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 376/773] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:21.612266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.749914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:21.768254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7d7d-aef9-4f40-a226-0dfe34fae100 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.795065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:21.801011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba9cb-c421-4443-8121-e98ac3fb47d3 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:21.812412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.813663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.814623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.815450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.816174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.817959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:21.830917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:21.832848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:21.833710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:21.836104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 398/774] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:21.841780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.844399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:21.845119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:21.845468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:21.845747 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:21.846756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:21.846881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:21.848486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:21.862153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 377/775] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:21.868840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:21.962718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d32c43-b0ff-4951-995d-6fed5cf23ab3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:22.006109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:22.007044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:22.007925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:22.008391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:22.009550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] RBAC: Adding query filter params (name=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:22.010074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:22.011727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:22.017999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 399/776] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:22.028507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:22.046998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7100e22-eda1-4069-9a24-bb64bf580ab5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:22.089386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:22.092472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:22.093251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:22.093616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:22.093896 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:22.094617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=db6463c9c59e408e9d6c81065bae02e2) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:22.095211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:22.099654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:22.110327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 378/777] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:21 2022] GET /identity/v3/role_assignments?user.id=db6463c9c59e408e9d6c81065bae02e2&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:22.213229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696cca-2e7b-44d2-ba3e-a2e67bfaf841 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:22.266425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:22.267414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:22.267834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:22.268243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:22.269046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] RBAC: Adding query filter params (type=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:22.269488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:22.270982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:22.276747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 400/778] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:22.282258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:22.320313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:22.410250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee4383-d9be-4308-b1f8-0e5f2e3d048f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:22.445083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51233b2-fc1b-454e-a582-6a4a05a96994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:22.445717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51233b2-fc1b-454e-a582-6a4a05a96994 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:22.445991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51233b2-fc1b-454e-a582-6a4a05a96994 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:22.446256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51233b2-fc1b-454e-a582-6a4a05a96994 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:22.446948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51233b2-fc1b-454e-a582-6a4a05a96994 None admin] RBAC: Adding query filter params (interface=public, service_id=56c2b5f2f64f411fb7c26650100d5d79, region_id=RegionOne) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:22.447248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51233b2-fc1b-454e-a582-6a4a05a96994 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:22.448668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51233b2-fc1b-454e-a582-6a4a05a96994 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:22.454187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 379/779] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:10:22 2022] GET /identity/v3/endpoints?service_id=56c2b5f2f64f411fb7c26650100d5d79&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:22.459603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:22.576714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:22.596231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39377a-37e9-4037-ae02-05811a6fdb4a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:22.640715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e5e6c-8a9b-4d4a-ab25-cde0978354b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:22.641326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e5e6c-8a9b-4d4a-ab25-cde0978354b6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:22.641601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e5e6c-8a9b-4d4a-ab25-cde0978354b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:22.642411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e5e6c-8a9b-4d4a-ab25-cde0978354b6 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:22.643018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e5e6c-8a9b-4d4a-ab25-cde0978354b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:22.644412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e5e6c-8a9b-4d4a-ab25-cde0978354b6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:22.651809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 401/780] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:22 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:22.903044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8760267-d5ec-478c-8030-940afe72077b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:22.903611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8760267-d5ec-478c-8030-940afe72077b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:22.903697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8760267-d5ec-478c-8030-940afe72077b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:22.905297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 380/781] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:22.910717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d99bc-8d74-4468-a80c-e06cb712b9ec None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:22.911011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d99bc-8d74-4468-a80c-e06cb712b9ec None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:22.911281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d99bc-8d74-4468-a80c-e06cb712b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:22.929498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a43d99bc-8d74-4468-a80c-e06cb712b9ec None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:22.930697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a43d99bc-8d74-4468-a80c-e06cb712b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:23.012673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 402/782] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:23.109658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63645687-ebfe-431e-8f3a-e5503c756e10 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:23.110019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63645687-ebfe-431e-8f3a-e5503c756e10 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:23.110195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63645687-ebfe-431e-8f3a-e5503c756e10 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:23.112034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 381/783] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:23.116897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708b7a1-94d3-4f2a-8318-e01cad50197a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:23.117189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708b7a1-94d3-4f2a-8318-e01cad50197a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:23.117464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708b7a1-94d3-4f2a-8318-e01cad50197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:23.142912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5708b7a1-94d3-4f2a-8318-e01cad50197a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:23.144195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5708b7a1-94d3-4f2a-8318-e01cad50197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:23.234178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 403/784] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:23.362981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63645687-ebfe-431e-8f3a-e5503c756e10 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:23.468927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:23.491651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63645687-ebfe-431e-8f3a-e5503c756e10 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:23.533240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:23.533934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:23.534214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:23.534534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:23.550345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:23.555473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:23.556471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:23.557299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 382/785] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:23.564814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708b7a1-94d3-4f2a-8318-e01cad50197a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:23.575920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:23.591239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:23.671443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708b7a1-94d3-4f2a-8318-e01cad50197a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:23.728150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:23.728773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:23.729051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:23.729319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:23.730268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:23.730571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:23.731976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:23.748031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 404/786] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:23.753843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:23.777697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9729c-032d-4844-8c62-75039d3d001c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:23.846425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:23.847061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:23.847341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:23.847615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:23.869334 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:23.875136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:23.876103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:23.876989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 383/787] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:23.882795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:23.893104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:23.897719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:23.937617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45899fc0-772e-4348-bc8e-ba3ea0904d13 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.011020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fce52-e2d6-42ab-bd09-887ef1a1a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.014027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fce52-e2d6-42ab-bd09-887ef1a1a3ff None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.014303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fce52-e2d6-42ab-bd09-887ef1a1a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.014571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fce52-e2d6-42ab-bd09-887ef1a1a3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.034601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fce52-e2d6-42ab-bd09-887ef1a1a3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.036179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fce52-e2d6-42ab-bd09-887ef1a1a3ff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-bd5fce52-e2d6-42ab-bd09-887ef1a1a3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:24.055997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:24.056970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:24.057860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:24.057860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:24.057860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:24.059172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847df21-03cb-413d-9cce-d2293a232df0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.062807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 405/788] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:24.065096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2e75-042b-4681-a3e4-d54dad541855 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.065379 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2e75-042b-4681-a3e4-d54dad541855 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.065653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2e75-042b-4681-a3e4-d54dad541855 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.067231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 406/789] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:24.067986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2e75-042b-4681-a3e4-d54dad541855 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.109331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96f2ad-0a11-4f5d-a0e3-a5110ec8c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.109931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96f2ad-0a11-4f5d-a0e3-a5110ec8c1ab None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.110202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96f2ad-0a11-4f5d-a0e3-a5110ec8c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.110470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96f2ad-0a11-4f5d-a0e3-a5110ec8c1ab None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.111126 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96f2ad-0a11-4f5d-a0e3-a5110ec8c1ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:24.111463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96f2ad-0a11-4f5d-a0e3-a5110ec8c1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.112835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96f2ad-0a11-4f5d-a0e3-a5110ec8c1ab None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.122541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 384/790] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:24.123876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c17b63-7d04-4d82-8443-65039d060f8d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.124164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c17b63-7d04-4d82-8443-65039d060f8d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.124425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c17b63-7d04-4d82-8443-65039d060f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.143321 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-20c17b63-7d04-4d82-8443-65039d060f8d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:24.144666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-20c17b63-7d04-4d82-8443-65039d060f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:24.198901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2e75-042b-4681-a3e4-d54dad541855 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.213631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:24.221100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 385/791] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:24.222042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c17b63-7d04-4d82-8443-65039d060f8d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.231774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:24.247559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.248579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.249354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.250073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.250910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:24.251571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.253718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.271220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 407/792] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:24.277383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.352797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c17b63-7d04-4d82-8443-65039d060f8d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.393155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.394165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.394663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.395133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.406759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.409580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:24.426427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:24.427467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:24.428364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:24.428364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:24.428364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:24.430761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 386/793] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:24.437135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.449697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dffb58-6d01-492d-8f02-4f5ac01ed22e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.492729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:24.499513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d843db-0cd5-4b72-82d1-7ab9b0b34ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.500141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d843db-0cd5-4b72-82d1-7ab9b0b34ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.500416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d843db-0cd5-4b72-82d1-7ab9b0b34ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.500684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d843db-0cd5-4b72-82d1-7ab9b0b34ba1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.509381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d843db-0cd5-4b72-82d1-7ab9b0b34ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.510838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d843db-0cd5-4b72-82d1-7ab9b0b34ba1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-66d843db-0cd5-4b72-82d1-7ab9b0b34ba1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:24.523014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:24.523987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 408/794] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:24.525464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3bc5-c945-42b6-858f-c4369353fe7a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.526116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3bc5-c945-42b6-858f-c4369353fe7a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.526116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3bc5-c945-42b6-858f-c4369353fe7a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.531068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 409/795] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:24.531774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3bc5-c945-42b6-858f-c4369353fe7a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.553085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ec076-9c1a-4d33-9ddd-8b27c8fcda59 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.578222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:24.588802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c9072-f1bd-4fcc-b3e8-fc239d2863fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.589403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9072-f1bd-4fcc-b3e8-fc239d2863fb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.589680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9072-f1bd-4fcc-b3e8-fc239d2863fb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.589950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9072-f1bd-4fcc-b3e8-fc239d2863fb None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.590589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c9072-f1bd-4fcc-b3e8-fc239d2863fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:24.590888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c9072-f1bd-4fcc-b3e8-fc239d2863fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.592288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c9072-f1bd-4fcc-b3e8-fc239d2863fb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.604721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 387/796] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:24.610112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ffda-a8a4-4bce-9ee7-f6709f233c25 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.610404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ffda-a8a4-4bce-9ee7-f6709f233c25 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.610711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ffda-a8a4-4bce-9ee7-f6709f233c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.631170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c739ffda-a8a4-4bce-9ee7-f6709f233c25 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:24.632636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c739ffda-a8a4-4bce-9ee7-f6709f233c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:24.642638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3bc5-c945-42b6-858f-c4369353fe7a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.683392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.684280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.684567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.684833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.685553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:24.685850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.687806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.711397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 388/797] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:24.711397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ffda-a8a4-4bce-9ee7-f6709f233c25 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.720436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 410/798] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:24.721333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.761198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:24.837322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:24.842596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed787040-6e48-4193-9439-f7ebb01f4cfa None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.849831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ffda-a8a4-4bce-9ee7-f6709f233c25 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:24.887337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.888340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.888813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.889276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.890110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.890240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:24.890852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:24.891179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:24.891481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:24.892493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.900523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:24.902002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:24.904648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:24.905611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 04:10:24.906438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:24.913792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 389/799] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:24.914383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:24.915414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 411/800] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:24.916369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:24.918036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.031512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96e423-e9fb-438e-90ce-fa9f357b9875 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.034978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.046249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ab1d7-ddae-4b66-9cd4-aa3a5fa822f0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.074921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.075597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.075895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.076121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.081786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.082393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.082670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.082940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.083605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:25.083906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.085272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.087083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.089015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.094411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 412/801] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:25.094411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:25.110477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:25.111694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:25.117366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:25.117366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:25.117366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:25.117366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 390/802] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:25.117366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.126077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.207041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45f527-2500-4a58-b2ac-332b56951db9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.234211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74b55-8324-4505-8525-1dbc3d17df56 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.240441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.241051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.241332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.241607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.242337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:25.242643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.244110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.261582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 413/803] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:25.262687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.277410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.278292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.278825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.279438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.290190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:25.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:25.296864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 391/804] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:25.300290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.319505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.351966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.371320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158dce8-faf8-4a56-b1c2-4f2ff25790fd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.401909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172bdfb-d8bf-4a72-9587-4b12a54d29c8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.405398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.405999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.406274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.406542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.407164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:25.407520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.408899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.413649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 414/805] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:25.414437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.440289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.440893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.441173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.441442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.442077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:25.442381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.443778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.455783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 392/806] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:25.456644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.516374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513b946-a408-47b3-af70-8fbf26e1bd43 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.536950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.552905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.553509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.553783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.554049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.559825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280b37-a72e-419b-971d-b0b9a5b3efe1 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.569775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.593984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61611d77-4f33-41b2-af53-6ea5418eb42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.594583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61611d77-4f33-41b2-af53-6ea5418eb42b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.594861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61611d77-4f33-41b2-af53-6ea5418eb42b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.595158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61611d77-4f33-41b2-af53-6ea5418eb42b None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.595848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61611d77-4f33-41b2-af53-6ea5418eb42b None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:25.596147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61611d77-4f33-41b2-af53-6ea5418eb42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.597522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61611d77-4f33-41b2-af53-6ea5418eb42b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.605318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 393/807] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:25.606403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839c3b-5e75-47e6-92b5-a9938eddfd31 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.606688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839c3b-5e75-47e6-92b5-a9938eddfd31 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.606961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839c3b-5e75-47e6-92b5-a9938eddfd31 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.610289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 394/808] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:25.610289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839c3b-5e75-47e6-92b5-a9938eddfd31 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.626807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.628278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.709542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839c3b-5e75-47e6-92b5-a9938eddfd31 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.724508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 415/809] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:25.725436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.745273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.745868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.746143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.746412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.747066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.748475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.757644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.770061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 395/810] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:25.770991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:25.776260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:25.840339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f59615-eaf6-4131-9bcd-7e972122b9b4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.885235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e2358-17b1-4971-830a-a1d6231407e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.886195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2358-17b1-4971-830a-a1d6231407e3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.886664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2358-17b1-4971-830a-a1d6231407e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.887005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2358-17b1-4971-830a-a1d6231407e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.887965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd560c-22a6-48ff-a8cd-4875eb7213e9 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:25.895634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e2358-17b1-4971-830a-a1d6231407e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.897209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e2358-17b1-4971-830a-a1d6231407e3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-733e2358-17b1-4971-830a-a1d6231407e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:25.910312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:25.911477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 416/811] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0c575-0d0f-47e2-a698-28588ce5ef7a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.913484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0c575-0d0f-47e2-a698-28588ce5ef7a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.914222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0c575-0d0f-47e2-a698-28588ce5ef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.926026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:25.927275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:25.927920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:25.928196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:25.931601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f3b0c575-0d0f-47e2-a698-28588ce5ef7a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:25.932909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3b0c575-0d0f-47e2-a698-28588ce5ef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:25.941899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:25.943569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:25.959123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:25.960138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:25.961010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:25.961010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:25.961010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:25.961010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 396/812] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:25.961244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.023395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 417/813] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:26.023395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0c575-0d0f-47e2-a698-28588ce5ef7a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.027935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.046581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.103700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa21bde-2045-411d-b8f3-8f19edc13678 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.121110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0c575-0d0f-47e2-a698-28588ce5ef7a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.149422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.150293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.150637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.151152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.156547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.157151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.157966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.158280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.159016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:26.159475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.160905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.164166 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.165602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.173692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 418/814] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:26.174525 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:26.183935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:26.184889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:26.185761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:26.185761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:26.185761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:26.186077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 397/815] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:26.187118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.278586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.287825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf64ee-4d4d-49a2-856f-1bbf56c650b4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.300922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.306823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e84b7-befa-44aa-bf07-f57cfcdca78a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.333441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.334329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.334606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.334878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.335811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:26.336529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.338430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.347420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.348072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.348350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.348622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/f7aaf3229ccf44718004798534537abc/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.350528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=f7aaf3229ccf44718004798534537abc, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.351993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.356606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 419/816] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:26.356606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.366221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 398/817] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:26 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/f7aaf3229ccf44718004798534537abc/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:26.367214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.494405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcbbdb-cdd0-4f5c-9336-4c9bd2cdde00 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.498443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411009e-4c50-4348-b227-d7ad93dee215 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.534068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.534506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.534786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.535073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] PATH_INFO: `/v3/services/network` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.535697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.537111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:26.547584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:26.549165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:26.549992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 399/818] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:26.550795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.551779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.552587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.553057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.553488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.554509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:26.554810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.557084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.572586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 420/819] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:26.573894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.578786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.593324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.675122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab87949-6a5b-4d94-963b-b3ab6717ed80 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.697510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118217-da2d-4cff-99ba-7b61282c728f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.717427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.718127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.718368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.718682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.729010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.731271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.743059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.743771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.744111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.744501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.745158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:26.745523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.747003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:26.749681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:26.750611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:26.752179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:26.753367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 400/820] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:26.753807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.756286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 421/821] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:26.761778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.843788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.874203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35bd4b-2302-4b82-ac77-2758ac43fcb7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.888493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:26.898718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8db1f-0e6a-4c82-a8da-16f30276c200 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:26.915308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.915948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.916222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.916489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.917211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:26.917512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.918995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.937457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 422/822] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:26.938381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:26.938722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:26.940095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:26.940371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:26.940634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:26.949260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:26.951125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:26.965016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:26.965926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 401/823] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:26.967582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:27.062003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01d4c2-a492-494b-80a5-77e3d0032a81 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.086085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc7e85-cd5d-4ade-9090-901925723f2c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.101217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.102191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.102664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.103150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.104004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] RBAC: Adding query filter params (type=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:27.104573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.106222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.107660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:27.117398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 423/824] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:27.118666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:27.124678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.125305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.125628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.125904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.138343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.139984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.142387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:27.157176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:27.158367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:27.159409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:27.159409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:27.159409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:27.166525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 402/825] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:27.166525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:27.248353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d378a12-83ac-4b62-9c96-c0831a34b782 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.290986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.292499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.292778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.293045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.293729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:27.294390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.295870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.301267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fabc-dd57-4ad8-bb9b-658cca16fd64 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.308807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 424/826] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:27.310060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:27.350409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.351427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.351905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.352367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.353218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.355218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.384650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:27.384852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 403/827] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:27.384852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:27.475167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:27.480965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea97bf-84c7-4c9f-ba60-0955bed91fcc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.570343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.570877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.571151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.572123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.572871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:27.573173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.574551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.587767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc7e5-dda7-4ed4-a193-6fec2eb727ea None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.591029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 425/828] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:27.597846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:27.625500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a4e91-42ab-4da7-83a5-75a46bcf6028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.626754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a4e91-42ab-4da7-83a5-75a46bcf6028 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.627045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a4e91-42ab-4da7-83a5-75a46bcf6028 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.627301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a4e91-42ab-4da7-83a5-75a46bcf6028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.628050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a4e91-42ab-4da7-83a5-75a46bcf6028 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=88339d0387834b8b8e833579efd7ee96) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:27.628350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a4e91-42ab-4da7-83a5-75a46bcf6028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.630087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a4e91-42ab-4da7-83a5-75a46bcf6028 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.637759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 404/829] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:27 2022] GET /identity/v3/role_assignments?user.id=88339d0387834b8b8e833579efd7ee96&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:27.710456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a46d-1c5b-47c3-9adc-f8acd3abeb7e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.727025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:27.737944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70235bf-4d56-47e0-b2f2-7b4604ce349b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.738283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70235bf-4d56-47e0-b2f2-7b4604ce349b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.738487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70235bf-4d56-47e0-b2f2-7b4604ce349b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.745489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 405/830] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:27.752128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef9ed-7a63-4c94-9993-ac13d35be5c7 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.752508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef9ed-7a63-4c94-9993-ac13d35be5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.752845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef9ed-7a63-4c94-9993-ac13d35be5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.755254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.756191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.756653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.757090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.765333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.767075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.779264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7dcef9ed-7a63-4c94-9993-ac13d35be5c7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:27.780520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7dcef9ed-7a63-4c94-9993-ac13d35be5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:27.788500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:27.789436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:27.790332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 426/831] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:27.796219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:27.864412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 406/832] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:27.914133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f14e95-1559-4833-8395-058df4156b6c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:27.949131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:27.949742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:27.950018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:27.950288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:27.950974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:27.951277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:27.952742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:27.965445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 427/833] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:27.971747 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef9ed-7a63-4c94-9993-ac13d35be5c7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:28.020230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:28.076925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef9ed-7a63-4c94-9993-ac13d35be5c7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:28.112683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:28.113342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:28.113701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:28.113984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/db6463c9c59e408e9d6c81065bae02e2/roles/d43a5dcacbf942afad5a4c0cbfb314a2` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:28.128703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=db6463c9c59e408e9d6c81065bae02e2, role_id=d43a5dcacbf942afad5a4c0cbfb314a2)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:28.130087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:28.147250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 407/834] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:27 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/db6463c9c59e408e9d6c81065bae02e2/roles/d43a5dcacbf942afad5a4c0cbfb314a2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:10:28.167995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:28.209815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:28.285002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17113-11cf-4184-ae82-89241cc120b7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:28.324329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c992d2-52bf-4fc2-83c3-ea9ea252b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:28.324962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c992d2-52bf-4fc2-83c3-ea9ea252b23b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:28.325237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c992d2-52bf-4fc2-83c3-ea9ea252b23b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:28.325507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c992d2-52bf-4fc2-83c3-ea9ea252b23b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:28.326097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c992d2-52bf-4fc2-83c3-ea9ea252b23b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:28.327491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c992d2-52bf-4fc2-83c3-ea9ea252b23b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-61c992d2-52bf-4fc2-83c3-ea9ea252b23b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:28.336955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:28.337937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:28.338769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 428/835] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:28.344103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:28.445387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:28.451931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725448d-d4c9-4c28-88ea-9df12b11d8a8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:28.472388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8879ea-e6a6-47af-bba1-e7822b4d8d3c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:28.472691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8879ea-e6a6-47af-bba1-e7822b4d8d3c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:28.472956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8879ea-e6a6-47af-bba1-e7822b4d8d3c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:28.474952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 429/836] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:28.482195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce679d9-06ef-4b9f-841d-2d64ed5a98c9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:28.482586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce679d9-06ef-4b9f-841d-2d64ed5a98c9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:28.482953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce679d9-06ef-4b9f-841d-2d64ed5a98c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:28.494265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:28.494866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:28.495138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:28.495434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:28.496058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:28.496349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:28.498319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:28.503162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9ce679d9-06ef-4b9f-841d-2d64ed5a98c9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:28.508330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 408/837] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:28.508454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9ce679d9-06ef-4b9f-841d-2d64ed5a98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:28.511107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:28.591065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 430/838] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:28.617636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412fd4-bba2-4dbf-ad08-17450322b989 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:28.654176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:28.655129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:28.655648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:28.656115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:28.656928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:28.657490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:28.659130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:28.664265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 409/839] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:28.887567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce679d9-06ef-4b9f-841d-2d64ed5a98c9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:28.916266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:28.989409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce679d9-06ef-4b9f-841d-2d64ed5a98c9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:29.024466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:29.025100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.025422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.025697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.036368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:29.041096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:29.042009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:29.042856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 431/840] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:29.048011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:29.073124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:29.159096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208adad-509e-4c78-8517-1c88aca504b4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:29.193431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:29.194038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.194319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.194588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.195251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:29.195581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:29.196949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:29.206231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 410/841] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:29.211753 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:29.303170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:29.317304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06aa59-887e-42d6-9bca-cdaa6eac440c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:29.352229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:29.352852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.353123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.353389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.364102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:29.365533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:29.380420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:29.381442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:29.383021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:29.383021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:29.383021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:29.383021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 432/842] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:29.388355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:29.480246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:29.496946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8c7f5-a3e7-40d4-89e8-a3ef388967c0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:29.530519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938742f-ce69-4dfd-b9c4-1b7824e98445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:29.531124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938742f-ce69-4dfd-b9c4-1b7824e98445 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.531421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938742f-ce69-4dfd-b9c4-1b7824e98445 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.531698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938742f-ce69-4dfd-b9c4-1b7824e98445 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.532863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938742f-ce69-4dfd-b9c4-1b7824e98445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:29.533177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938742f-ce69-4dfd-b9c4-1b7824e98445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:29.534540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938742f-ce69-4dfd-b9c4-1b7824e98445 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:29.546583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 411/843] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:29.552484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:29.661412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee896c-12ce-452a-a07a-b73a8cc52bf2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:29.696819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:29.697447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.697733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.698005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.703485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625186-c2c0-4551-a790-1f36722a5dd2 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.703767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625186-c2c0-4551-a790-1f36722a5dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.704042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625186-c2c0-4551-a790-1f36722a5dd2 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.706255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 412/844] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:29.707237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:29.708727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:29.711491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:29.711704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8c026-2105-4e52-8de2-794cd92ca24e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.711976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8c026-2105-4e52-8de2-794cd92ca24e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.712239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8c026-2105-4e52-8de2-794cd92ca24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:29.722699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:29.723710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 04:10:29.724670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:29.726789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 433/845] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:29.731472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-cbf8c026-2105-4e52-8de2-794cd92ca24e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:29.731946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:29.732826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cbf8c026-2105-4e52-8de2-794cd92ca24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:29.826369 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 413/846] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:29.850353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08086-2692-4b6e-8228-18437c04fb8b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:29.886758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:29.887676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:29.888573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:29.888990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:29.889858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:29.890297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:29.891994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:29.910378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 434/847] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Sep 6 04:10:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:29.916147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8c026-2105-4e52-8de2-794cd92ca24e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.006742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:30.037037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8c026-2105-4e52-8de2-794cd92ca24e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.073790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd486c-b78a-4dd3-a37b-5851ea395255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.074755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd486c-b78a-4dd3-a37b-5851ea395255 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.075239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd486c-b78a-4dd3-a37b-5851ea395255 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.075740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd486c-b78a-4dd3-a37b-5851ea395255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.090472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.152877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:30.172494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd486c-b78a-4dd3-a37b-5851ea395255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:30.174655 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd486c-b78a-4dd3-a37b-5851ea395255 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:30.209240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbe6f-6ff2-4a2e-ba57-b4873ead83e9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.250279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820c7ce-19c9-40d3-bf4d-0ec59fd24557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.251891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820c7ce-19c9-40d3-bf4d-0ec59fd24557 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.252380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820c7ce-19c9-40d3-bf4d-0ec59fd24557 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.252837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820c7ce-19c9-40d3-bf4d-0ec59fd24557 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.253610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820c7ce-19c9-40d3-bf4d-0ec59fd24557 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:30.255187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820c7ce-19c9-40d3-bf4d-0ec59fd24557 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:30.261698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9820c7ce-19c9-40d3-bf4d-0ec59fd24557 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:30.265175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:30.268285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:30.270665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:30.275535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 435/848] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:30.275535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61fb3-a03e-49dd-a5a0-79e7c6a24532 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.275535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61fb3-a03e-49dd-a5a0-79e7c6a24532 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.275535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61fb3-a03e-49dd-a5a0-79e7c6a24532 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.275863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 436/849] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:30.280408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61fb3-a03e-49dd-a5a0-79e7c6a24532 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.299440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 414/850] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:30.299440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f424-d97d-4673-b7ee-7d8932dd5ce9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.299440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f424-d97d-4673-b7ee-7d8932dd5ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.299440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f424-d97d-4673-b7ee-7d8932dd5ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.322193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e252f424-d97d-4673-b7ee-7d8932dd5ce9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:30.323461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e252f424-d97d-4673-b7ee-7d8932dd5ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:30.393031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 415/851] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:30.393879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f424-d97d-4673-b7ee-7d8932dd5ce9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.402744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61fb3-a03e-49dd-a5a0-79e7c6a24532 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.427798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:30.442527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.443412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.443891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.444332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.445163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:30.445729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:30.447414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:30.457987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 437/852] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:30.459525 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.514933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f424-d97d-4673-b7ee-7d8932dd5ce9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.517616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:30.552561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.553477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.553927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.554396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.565889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:30.567642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:30.573482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768179d3-c6b7-4092-9fba-914e2d00143c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:30.583308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:30.584347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:30.585212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:30.585212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:30.585212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:30.591573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 416/853] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:30.593050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.614284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f007241-a249-4996-9343-905a3b9c20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.614994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f007241-a249-4996-9343-905a3b9c20a9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.615346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f007241-a249-4996-9343-905a3b9c20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.615756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f007241-a249-4996-9343-905a3b9c20a9 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.616465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f007241-a249-4996-9343-905a3b9c20a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:30.616846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f007241-a249-4996-9343-905a3b9c20a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:30.618366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f007241-a249-4996-9343-905a3b9c20a9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:30.631412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 438/854] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:30.645096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2db6-7356-49fd-adac-c912246bcf28 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.645526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2db6-7356-49fd-adac-c912246bcf28 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.645898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2db6-7356-49fd-adac-c912246bcf28 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.647655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 439/855] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:30.654045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857828-e074-46f6-b880-8f8286ff860d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.654333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857828-e074-46f6-b880-8f8286ff860d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.654606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857828-e074-46f6-b880-8f8286ff860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.675059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-db857828-e074-46f6-b880-8f8286ff860d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:30.676314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-db857828-e074-46f6-b880-8f8286ff860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:30.732289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fde5c-c732-441d-9ec0-52c18d77494e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.734519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:30.763536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 440/856] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:30.764747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db857828-e074-46f6-b880-8f8286ff860d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.773410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.774399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.774399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.774588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.775203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:30.775543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:30.777208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:30.790992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 417/857] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:30.797418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.821977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:30.888828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db857828-e074-46f6-b880-8f8286ff860d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.922487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3030b-7f10-4234-b7e5-fa54b31d5bb4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:30.941218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.942735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.943307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.943905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.960283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:30.960868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:30.961070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:30.961412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:30.961798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:30.968997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:30.970675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:10:30.972008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:30.973170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:30.973794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:30.979772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 441/858] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:30.981815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:30.996175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:30.997282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:30.998378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:31.003854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 418/859] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:31.006022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:31.044441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:31.089878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:31.107979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63061b-6cea-494e-bd1f-eb5e17e1c7fb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.114531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fef9c-41ff-491a-84ac-4bd041905004 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.144628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.145386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.145898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.146083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.146808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:31.147174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.148629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.150874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.151573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.151922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.152262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.153018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:31.153394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.154891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.159429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 442/860] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:10:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:31.159429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:31.172021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 419/861] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:31.173131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:31.264291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015b826-4f9e-4841-aaaa-3e93e23c0981 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.265922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:31.293873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2d52-1039-4c51-8a67-49ee2d9e2e54 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.309360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.310282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.310746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.311083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.311783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.313382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.334511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:31.339799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 443/862] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:31 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:31.340353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.341002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.341523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.342102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:31.342231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.354491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.356246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:31.373993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:31.375205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:31.376951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:31.376951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:31.376951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:31.383436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 420/863] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:31.384652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:31.489280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dcaf6-b49c-42e4-8665-77ff74559bd0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.510343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618946-ad08-4a4e-a961-29f4c7ea9c9a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.534097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.534713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.534988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.535256 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.536026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=f7aaf3229ccf44718004798534537abc) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:31.536336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.537769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.544042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 444/864] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:31 2022] GET /identity/v3/role_assignments?user.id=f7aaf3229ccf44718004798534537abc&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:31.548721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.549449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.549834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.550196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.550951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:31.551351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.552888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.567524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 421/865] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:31.573263 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:31.608586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:31.696541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b325fa-45af-460a-8729-868e09c42ba1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.734259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.734899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.735222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.735561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.744219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.745672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:31.759504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:31.760510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:31.761433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 445/866] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:10:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:31.768631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:31.817845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:31.873078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f8bc-deb0-47e8-8fa9-5ef8da7b23b6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:31.908372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:31.908972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:31.909242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:31.909513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:31.910222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:31.910519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:31.911972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:31.929648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 422/867] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Sep 6 04:10:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:31.936477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:32.038436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:32.055035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557fbe-b949-49f6-8503-7c4adaf7f72e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:32.090227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:32.090756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:32.091027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:32.091296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:32.163080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:32.164558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:32.250771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:32.267898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 446/868] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:31 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:32.273482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:32.378110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e71403-caaf-40ed-a9c3-83f331178d37 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:32.379599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:32.413410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccd809-91ca-4d55-a833-982b2eb339df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:32.414031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd809-91ca-4d55-a833-982b2eb339df None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:32.414299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd809-91ca-4d55-a833-982b2eb339df None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:32.414561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd809-91ca-4d55-a833-982b2eb339df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:32.425289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccd809-91ca-4d55-a833-982b2eb339df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:32.426802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccd809-91ca-4d55-a833-982b2eb339df None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-55ccd809-91ca-4d55-a833-982b2eb339df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:32.441644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:32.442585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:32.443512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:32.443512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:32.443512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:32.443512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 423/869] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:32.448674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:32.552262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161af5-fdcb-4c36-9474-d05f62f552b0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:32.585982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:32.586591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:32.586862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:32.587130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:32.587793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:32.588090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:32.589446 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:32.599449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82838e05-22d1-483c-a503-842a77b4c415 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:32.599742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82838e05-22d1-483c-a503-842a77b4c415 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:32.600020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82838e05-22d1-483c-a503-842a77b4c415 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:32.602197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 447/871] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:32.603145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 424/871] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:32.607445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:32.607865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ce539-81f4-428d-a3fd-2f8fb3346510 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:32.608067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ce539-81f4-428d-a3fd-2f8fb3346510 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:32.608341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ce539-81f4-428d-a3fd-2f8fb3346510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:32.628341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9f6ce539-81f4-428d-a3fd-2f8fb3346510 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:32.629636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9f6ce539-81f4-428d-a3fd-2f8fb3346510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:32.663300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:32.711174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 425/872] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:32.730500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40be2-97ad-4666-b2fb-dcfde0a40946 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:32.769815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:32.770439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:32.770714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:32.770983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:32.777781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:32.779225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:32.791695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:32.793755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:32.796104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 448/873] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:32.803493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ce539-81f4-428d-a3fd-2f8fb3346510 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:32.883444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:32.900811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ce539-81f4-428d-a3fd-2f8fb3346510 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:32.942876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:32.943522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:32.943807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:32.944076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:32.944771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:32.945075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:32.946511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:32.959684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 426/874] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:32.965179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:33.022981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:33.085213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50bb6-21e5-4566-9b6d-e20787e2c215 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:33.093047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:33.124235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f825a-7356-4a08-8ce7-3b80c562b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:33.124935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f825a-7356-4a08-8ce7-3b80c562b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:33.125214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f825a-7356-4a08-8ce7-3b80c562b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:33.125479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f825a-7356-4a08-8ce7-3b80c562b9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:33.126828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f825a-7356-4a08-8ce7-3b80c562b9d3 None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=db6463c9c59e408e9d6c81065bae02e2) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:33.127183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f825a-7356-4a08-8ce7-3b80c562b9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:33.128640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f825a-7356-4a08-8ce7-3b80c562b9d3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:33.135508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 449/875] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:32 2022] GET /identity/v3/role_assignments?user.id=db6463c9c59e408e9d6c81065bae02e2&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:33.136907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8af4c7-8c79-4a97-a29b-16f342872e24 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:33.177039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9cab3-6bd5-4dde-8a61-f484ded41888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:33.177999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9cab3-6bd5-4dde-8a61-f484ded41888 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:33.178476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9cab3-6bd5-4dde-8a61-f484ded41888 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:33.178895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9cab3-6bd5-4dde-8a61-f484ded41888 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:33.179808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9cab3-6bd5-4dde-8a61-f484ded41888 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:33.181412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9cab3-6bd5-4dde-8a61-f484ded41888 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:33.206436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 427/876] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:33 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:33.384380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc43d-9b8d-4fe6-8993-e18d81efd015 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:33.384662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc43d-9b8d-4fe6-8993-e18d81efd015 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:33.384932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc43d-9b8d-4fe6-8993-e18d81efd015 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:33.386451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 450/877] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:33.392776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ade6d5-e3ae-46f7-8a14-1b8440b0cd15 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:33.393257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ade6d5-e3ae-46f7-8a14-1b8440b0cd15 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:33.393257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ade6d5-e3ae-46f7-8a14-1b8440b0cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:33.401720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:33.414963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-61ade6d5-e3ae-46f7-8a14-1b8440b0cd15 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:33.416950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-61ade6d5-e3ae-46f7-8a14-1b8440b0cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:33.509047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 428/878] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:33.578715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26920408-18b8-424d-ba42-67b941d6974a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:33.579035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26920408-18b8-424d-ba42-67b941d6974a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:33.579283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26920408-18b8-424d-ba42-67b941d6974a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:33.580913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 451/879] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:33.586381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc8e1b-a5f8-412a-b5b5-43c0417691fd None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:33.586656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc8e1b-a5f8-412a-b5b5-43c0417691fd None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:33.586934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc8e1b-a5f8-412a-b5b5-43c0417691fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:33.605774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2abc8e1b-a5f8-412a-b5b5-43c0417691fd None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:33.606975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2abc8e1b-a5f8-412a-b5b5-43c0417691fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:33.691596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 429/880] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:33.788295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26920408-18b8-424d-ba42-67b941d6974a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:33.893636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26920408-18b8-424d-ba42-67b941d6974a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:33.934138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:33.935010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:33.935483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:33.935912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:33.936632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:33.938191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:33.948960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:33.950376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:33.951502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:33.954258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 452/881] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:33.959881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc8e1b-a5f8-412a-b5b5-43c0417691fd None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:33.964812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:34.014888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:34.036147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:34.085841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc8e1b-a5f8-412a-b5b5-43c0417691fd None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:34.111682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcd5a-c1ca-4571-be25-49937d6c3496 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:34.126666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:34.127270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:34.127598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:34.127875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:34.128464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:34.128761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:34.130134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:34.137258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 430/882] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:34.143481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:34.155749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:34.156622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:34.157051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:34.158476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:34.159216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:34.161189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:34.173858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:34.175106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:34.176196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:34.179081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 453/883] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:34.184488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:34.272980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87445503-92fb-4e5c-ae3a-a49709046d3d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:34.307021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:34.311414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0deb47-b281-4e5a-a8ee-06d903554b6b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:34.321597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:34.322281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:34.322627 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:34.323343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:34.324033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:34.324360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:34.326398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:34.333218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 431/884] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:34.338782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:34.341081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:34.354967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:34.355626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:34.355925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:34.356174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:34.356862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:34.357169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:34.358594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:34.364070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 454/885] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:34.369606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:34.480177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1543e-2205-43ee-94e7-0703640f4206 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:34.481387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3367-6dbd-4d98-a591-976604708790 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:34.520776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:34.521624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:34.521995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:34.522376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:34.523221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] RBAC: Adding query filter params (interface=public, service_id=4ce530f03edc4a09bc50a65d092f73db, region_id=RegionOne) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:34.523606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:34.525350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:34.525568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effffc6a-cb5d-4dc6-9a57-09b4aa6d2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:34.526472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffc6a-cb5d-4dc6-9a57-09b4aa6d2599 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:34.526901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffc6a-cb5d-4dc6-9a57-09b4aa6d2599 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:34.527703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffc6a-cb5d-4dc6-9a57-09b4aa6d2599 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:34.528535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effffc6a-cb5d-4dc6-9a57-09b4aa6d2599 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:34.529616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effffc6a-cb5d-4dc6-9a57-09b4aa6d2599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:34.531554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effffc6a-cb5d-4dc6-9a57-09b4aa6d2599 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:34.537286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 432/886] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:10:34 2022] GET /identity/v3/endpoints?service_id=4ce530f03edc4a09bc50a65d092f73db&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:34.538521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:34.547730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 455/887] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:34.605761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:34.660161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4ec8e-3f40-44ff-8b54-c8a0d9eafeb2 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:34.700505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d2e11-d0e3-4862-a14e-40587357416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:34.701249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d2e11-d0e3-4862-a14e-40587357416d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:34.701537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d2e11-d0e3-4862-a14e-40587357416d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:34.701804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d2e11-d0e3-4862-a14e-40587357416d None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:34.702402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d2e11-d0e3-4862-a14e-40587357416d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:34.704720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d2e11-d0e3-4862-a14e-40587357416d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:34.711053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 433/888] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:34 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:10:35.257232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076da3-8d6b-437a-ac5d-79a361992f90 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:35.258004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076da3-8d6b-437a-ac5d-79a361992f90 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:35.258004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076da3-8d6b-437a-ac5d-79a361992f90 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:35.259556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 456/889] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:35.264598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94dae-d95e-4d45-9af1-94fa503448b3 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:35.264882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94dae-d95e-4d45-9af1-94fa503448b3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:35.265158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94dae-d95e-4d45-9af1-94fa503448b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:35.284112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-01e94dae-d95e-4d45-9af1-94fa503448b3 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:35.285301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-01e94dae-d95e-4d45-9af1-94fa503448b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:35.356508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 434/890] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:35.382895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cfc27-437c-4826-95dc-45ba37461d97 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:35.383211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cfc27-437c-4826-95dc-45ba37461d97 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:35.383484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cfc27-437c-4826-95dc-45ba37461d97 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:35.384964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 457/891] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:35.390298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cc18a-4931-4ad0-8fcb-6808a004248a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:35.390806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cc18a-4931-4ad0-8fcb-6808a004248a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:35.391304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cc18a-4931-4ad0-8fcb-6808a004248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:35.410547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-fa7cc18a-4931-4ad0-8fcb-6808a004248a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:35.411763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fa7cc18a-4931-4ad0-8fcb-6808a004248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:35.455273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:35.480889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 435/892] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:35.630875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cfc27-437c-4826-95dc-45ba37461d97 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:35.661620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:35.741631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cfc27-437c-4826-95dc-45ba37461d97 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:35.750659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cc18a-4931-4ad0-8fcb-6808a004248a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:35.785161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:35.786314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:35.787088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:35.787710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:35.802621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:35.808950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:35.809863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:35.810683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:35.812773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 458/893] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Sep 6 04:10:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:35.821147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:35.871222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cc18a-4931-4ad0-8fcb-6808a004248a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:35.909163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:35.909716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:35.910002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:35.910565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:35.910677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:35.911945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:35.913441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:35.924037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:35.924977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:35.928050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 436/894] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Sep 6 04:10:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:35.931131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:35.932762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147d22-abe4-41db-a682-9591a80827da None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:35.975745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:35.982842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:35.983807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:35.984264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:35.984834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:35.986012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:35.986495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:35.991508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.009528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 459/895] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Sep 6 04:10:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:36.010859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.058954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3ff19-dff7-4187-b542-dd3d7ff62802 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.105098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.105953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.106401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.106832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.107641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:36.108591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.110931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.118814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 437/896] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:36.124764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.126095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c91b3-ef74-4192-bb33-c5f14cdbfc31 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.164724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.165536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.165910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.166315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.178958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.180636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.190087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:36.197542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:36.198762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:36.199989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:36.199989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:36.199989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:36.206205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 460/897] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:36.207502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.259839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136c80b-2e6f-439b-b422-e025ae069d43 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.263504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:36.311814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.312416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.312688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.312953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.313626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:36.313925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.315316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.324246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 438/898] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:36.331147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.336553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286a923-af3c-4deb-9d83-d4995554ce65 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.386410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.387401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.387883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.388885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.390059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:36.390577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.393112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.410677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 461/899] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:36.416378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.446560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda11db-10a2-46e5-b136-cd186fc2ded0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.489545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3dee1-ac40-412e-8d63-d066f235ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.490500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3dee1-ac40-412e-8d63-d066f235ad82 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.490803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:36.491644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3dee1-ac40-412e-8d63-d066f235ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.492209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3dee1-ac40-412e-8d63-d066f235ad82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.493159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3dee1-ac40-412e-8d63-d066f235ad82 None admin] RBAC: Adding query filter params (interface=public, service_id=4e9e921a342b40d182f86f907199f116, region_id=RegionOne) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:36.493626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3dee1-ac40-412e-8d63-d066f235ad82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.495173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3dee1-ac40-412e-8d63-d066f235ad82 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.501759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 439/900] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/endpoints?service_id=4e9e921a342b40d182f86f907199f116&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:36.503515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418783-f400-413c-92ff-2618219d12ad None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.504017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418783-f400-413c-92ff-2618219d12ad None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.504439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418783-f400-413c-92ff-2618219d12ad None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.505909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 440/901] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:36.508262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c418783-f400-413c-92ff-2618219d12ad None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.536855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68882a-f43f-45d2-9113-db6308e05f61 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.542317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:36.575782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b25b23-3052-4e99-9605-51e27748cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.576405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b25b23-3052-4e99-9605-51e27748cf8e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.576686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b25b23-3052-4e99-9605-51e27748cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.576955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b25b23-3052-4e99-9605-51e27748cf8e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.584693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b25b23-3052-4e99-9605-51e27748cf8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.586730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b25b23-3052-4e99-9605-51e27748cf8e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a6b25b23-3052-4e99-9605-51e27748cf8e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:36.598939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:36.600100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 462/902] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:36.601046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5ad3-f9e0-4013-bd7c-183a5bdfb09b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.601690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5ad3-f9e0-4013-bd7c-183a5bdfb09b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.601690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5ad3-f9e0-4013-bd7c-183a5bdfb09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.618995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9dbe5ad3-f9e0-4013-bd7c-183a5bdfb09b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:36.620210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9dbe5ad3-f9e0-4013-bd7c-183a5bdfb09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:36.626138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c418783-f400-413c-92ff-2618219d12ad None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.663285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.663924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.664199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.664463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.665471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.667256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.673523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 441/903] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:10:36.674222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.708187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 463/904] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:36.709585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3366-0ec3-40e2-9d7d-3b6ae61d6ebc None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.709868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3366-0ec3-40e2-9d7d-3b6ae61d6ebc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.710136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3366-0ec3-40e2-9d7d-3b6ae61d6ebc None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.715398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 464/905] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:36.717001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299897d-e871-4986-8d07-3dee9010e1be None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.717287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299897d-e871-4986-8d07-3dee9010e1be None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.717561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299897d-e871-4986-8d07-3dee9010e1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.738474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2299897d-e871-4986-8d07-3dee9010e1be None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:36.740119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2299897d-e871-4986-8d07-3dee9010e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:36.800029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:36.817958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:36.827329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe40ba-46dc-4a95-9dab-d12c423bd0df None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:36.832683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 465/906] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:36.872433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:36.873095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:36.873382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:36.873687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:36.874481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:36.874781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:36.876818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:36.896184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 442/907] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:36.901729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299897d-e871-4986-8d07-3dee9010e1be None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:36.993159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.024634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299897d-e871-4986-8d07-3dee9010e1be None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.061618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.062688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.063185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.064224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.119909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223778f-1656-4384-bb26-55d6bd4ae70c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.129905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:37.152362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.154296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.159866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.160692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.161141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.161580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.162407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.164491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.186703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 443/908] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:36 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:10:37.187608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.206967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:37.309929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 466/909] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:36 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:37.318223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.331313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d016fd9-ae2a-4912-bd69-a8fc49ab4204 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.377028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.377694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.377971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.378237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.378844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.380244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:37.389562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:37.390563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:37.391415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 444/910] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:37.396644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.428325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:37.450182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35fcf4-7316-43d2-a7bc-19c29f74c34b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.476349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:37.488606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.489476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.489931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.490375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.502107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.503879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.503990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac69e3-16dc-4343-bb5d-0c3f663e73b6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:37.520100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:37.521059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:37.521937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:37.521937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:37.521937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:37.523985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 467/911] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:37.530683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.544964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.545567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.545841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.546110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.546853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:37.547153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.549103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.558600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 445/912] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:37.560053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.659347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15c2b7-13c0-4590-9355-be6676bb67e5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.676984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bca94-b810-402a-abf1-7eb48188929c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.690798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:37.698204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.698827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.699109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.699396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.700076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:37.700381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.701989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.719237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 468/913] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:37.720897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.733775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.734516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.734856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.735213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.736482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:37.736851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.738427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.747708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 446/914] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Sep 6 04:10:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:37.750168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.753147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:37.860007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d114-916f-4c2b-ad2c-282e44fd9685 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.871360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be62156-a289-454b-ba04-e87af9a7be47 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:37.902271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.903077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.903447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.903786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.908794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:37.909395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:37.909674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:37.909944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:37.910608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.911936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:37.912068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.913455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:37.927171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:37.928123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:37.929760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 469/915] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:37.934353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:37.940873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 447/916] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:10:38.011196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:38.066894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe51b-6179-44e6-91b0-ae83b9893c95 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:38.114717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f930bce-d62f-4070-8b7b-b921aa9adac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:38.115254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f930bce-d62f-4070-8b7b-b921aa9adac0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:38.115559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f930bce-d62f-4070-8b7b-b921aa9adac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:38.115830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f930bce-d62f-4070-8b7b-b921aa9adac0 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:38.116568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f930bce-d62f-4070-8b7b-b921aa9adac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:38.116878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f930bce-d62f-4070-8b7b-b921aa9adac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:38.118303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f930bce-d62f-4070-8b7b-b921aa9adac0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:38.130867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 470/917] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:38.137599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:38.202189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:38.249268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556794d-1ac1-4b26-b043-42009176a347 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:38.286305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d8676-3868-4456-ad5a-56ff1d315fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:38.286913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8676-3868-4456-ad5a-56ff1d315fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:38.287190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8676-3868-4456-ad5a-56ff1d315fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:38.287503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8676-3868-4456-ad5a-56ff1d315fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:38.288237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d8676-3868-4456-ad5a-56ff1d315fb4 None admin] RBAC: Adding query filter params (role.id=e0097dc71a9f4d05b07f46f1bc332a18, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=db6463c9c59e408e9d6c81065bae02e2) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:38.288546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d8676-3868-4456-ad5a-56ff1d315fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:38.289987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d8676-3868-4456-ad5a-56ff1d315fb4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:38.296169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 448/918] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:38 2022] GET /identity/v3/role_assignments?user.id=db6463c9c59e408e9d6c81065bae02e2&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=e0097dc71a9f4d05b07f46f1bc332a18 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:38.689703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c838-468a-4203-9aa0-43f007d74d29 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:38.690231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c838-468a-4203-9aa0-43f007d74d29 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:38.690231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c838-468a-4203-9aa0-43f007d74d29 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:38.691846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 471/919] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:38.696950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e529e19-2a2a-4793-ba24-44f52dba60c1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:38.697240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e529e19-2a2a-4793-ba24-44f52dba60c1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:38.697514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e529e19-2a2a-4793-ba24-44f52dba60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:38.716811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5e529e19-2a2a-4793-ba24-44f52dba60c1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:38.717994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5e529e19-2a2a-4793-ba24-44f52dba60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:38.790809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 449/920] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:39.073438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c838-468a-4203-9aa0-43f007d74d29 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:39.184623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c838-468a-4203-9aa0-43f007d74d29 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:39.194834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:39.220816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78b232-95f4-4f2f-a1a9-4b4a101f42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:39.221438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78b232-95f4-4f2f-a1a9-4b4a101f42bc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:39.221712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78b232-95f4-4f2f-a1a9-4b4a101f42bc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:39.221979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78b232-95f4-4f2f-a1a9-4b4a101f42bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:39.222557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78b232-95f4-4f2f-a1a9-4b4a101f42bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:39.223950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78b232-95f4-4f2f-a1a9-4b4a101f42bc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-fd78b232-95f4-4f2f-a1a9-4b4a101f42bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:39.232856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:39.233792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:39.234676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 472/921] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Sep 6 04:10:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:39.240840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e529e19-2a2a-4793-ba24-44f52dba60c1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:39.284134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800be5-7163-454e-81dd-a6f5f27d0032 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:39.284724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800be5-7163-454e-81dd-a6f5f27d0032 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:39.285196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800be5-7163-454e-81dd-a6f5f27d0032 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:39.286975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 473/922] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:39.292154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec74b-b68c-4492-9ad8-a60486565b34 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:39.292690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec74b-b68c-4492-9ad8-a60486565b34 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:39.293162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec74b-b68c-4492-9ad8-a60486565b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:39.299761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:39.312461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b08ec74b-b68c-4492-9ad8-a60486565b34 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:39.314159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b08ec74b-b68c-4492-9ad8-a60486565b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:39.361141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e529e19-2a2a-4793-ba24-44f52dba60c1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:39.404827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 474/923] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:39.410108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:39.410108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:39.410108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:39.410108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:39.410437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:39.410437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:39.410437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:39.414359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 450/924] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:39.419742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec74b-b68c-4492-9ad8-a60486565b34 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:39.524982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec74b-b68c-4492-9ad8-a60486565b34 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:39.526541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:39.560579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:39.561112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:39.561391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:39.561661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:39.562286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:39.562583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:39.563999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:39.569291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 475/925] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:39.574875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:39.683111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f88a-8c08-4190-9fb0-e380e3462385 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:39.700168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:39.713845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:39.723125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:39.724310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:39.724593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:39.724865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:39.725547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:39.727505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:39.761132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 451/926] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:39.838210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528c379-ed9c-425a-aa50-c3623dff4ead None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:39.885128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c588e-e193-459b-b571-589cbe92d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:39.885770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c588e-e193-459b-b571-589cbe92d751 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:39.886044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c588e-e193-459b-b571-589cbe92d751 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:39.886318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c588e-e193-459b-b571-589cbe92d751 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:39.886899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c588e-e193-459b-b571-589cbe92d751 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:39.891559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c588e-e193-459b-b571-589cbe92d751 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-400c588e-e193-459b-b571-589cbe92d751 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:39.900952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:39.902000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:39.903089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 476/927] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:39.916119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.023627 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fbf49-52d7-43c2-bf66-3cacda4592a7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:40.042802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ebbf-ec65-4896-8fab-f1ade7a84b39 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.043129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ebbf-ec65-4896-8fab-f1ade7a84b39 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.043353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ebbf-ec65-4896-8fab-f1ade7a84b39 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.045066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 477/928] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:40.050676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfcc17-b2b8-4fd0-a182-083ba4a14624 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.050959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfcc17-b2b8-4fd0-a182-083ba4a14624 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.051233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfcc17-b2b8-4fd0-a182-083ba4a14624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.061010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:40.061650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.061930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.062202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.062847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:40.063147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:40.064590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:40.070616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 452/929] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:40.071790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0dbfcc17-b2b8-4fd0-a182-083ba4a14624 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:40.072976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0dbfcc17-b2b8-4fd0-a182-083ba4a14624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:40.075999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.104158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:40.123554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:40.175463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 478/930] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:40.200291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34b85-9761-4b6c-ab82-9b9b7d758bbd None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:40.236375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:40.237410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.237903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.238375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.239217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:40.239772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:40.241362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:40.247698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 453/931] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:40.247853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43335e-3c6f-496e-ad66-7053d088080b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.248128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43335e-3c6f-496e-ad66-7053d088080b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.248396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43335e-3c6f-496e-ad66-7053d088080b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.249726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 479/932] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:40.253484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.255162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba180e8-97d1-4550-b502-e5c840e2e352 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.255467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba180e8-97d1-4550-b502-e5c840e2e352 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.255744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba180e8-97d1-4550-b502-e5c840e2e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.279497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1ba180e8-97d1-4550-b502-e5c840e2e352 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:40.281409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1ba180e8-97d1-4550-b502-e5c840e2e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:40.365660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 480/933] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:40.373933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:40.378048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c4e2-f836-4241-8352-932a57f8e977 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:40.413719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:40.414670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.415153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.415661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.416558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] RBAC: Adding query filter params (interface=public, service_id=45bf2a0af2c54d35a08405d94846158d, region_id=RegionOne) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:40.417119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:40.418743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:40.425377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 454/934] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:10:40 2022] GET /identity/v3/endpoints?service_id=45bf2a0af2c54d35a08405d94846158d&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:40.431058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba180e8-97d1-4550-b502-e5c840e2e352 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.480241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.526386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:40.543125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba180e8-97d1-4550-b502-e5c840e2e352 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:40.580695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:40.581675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.582233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.582685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.583515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:40.585244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:40.588005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3d5a-ccea-4bf6-8348-9eb76d940a14 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:40.596573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 481/935] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:40 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:10:40.626596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:40.627133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.627446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.627723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.628389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:40.629867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:40.632858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING keystone.server.flask.common [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 04:10:40.658351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.sql.core [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 04:10:40.658351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 04:10:40.658351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [parameters: {'id': '61c438b9f4154f48a28974c476baf22f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 04:10:40.658351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81627) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 04:10:40.679537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61c438b9f4154f48a28974c476baf22f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61c438b9f4154f48a28974c476baf22f. Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application conn.query(q) Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 04:10:40.680214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application result.read() Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 04:10:40.681046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application next(self.gen) Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application yield resource Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application next(self.gen) Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise self.value Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application session.commit() Sep 06 04:10:40.682107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self.session.flush() Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application compat.raise_( Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 04:10:40.683016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 04:10:40.683959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application conn.query(q) Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application result.read() Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 04:10:40.684749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [parameters: {'id': '61c438b9f4154f48a28974c476baf22f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:40.685606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:40.687982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61c438b9f4154f48a28974c476baf22f. Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 455/936] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Sep 6 04:10:40 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:40.690223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.714918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:40.819976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd46a40-ae7c-46f3-971a-46684aae91d4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:40.820764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b87c3-f10a-4b9d-bf5e-ac1cc9a2506f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:40.855785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:40.856425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.856702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.856973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.857286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:40.858162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:40.858505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:40.858928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:40.864732 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:40.866417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:40.871888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:40.877375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:40.878436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:40.879310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:40.880573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:40.882734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:40.884955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:40.885965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 482/937] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Sep 6 04:10:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:40.886114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 456/938] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:40.889190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.889477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:40.909297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:41.015279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:41.025200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71b9a6-ea34-461c-9dc1-c27654d53a5a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:41.044194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dd0bd-e801-4bc7-8e4c-1622969be465 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:41.062080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:41.062822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.063100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.063433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.064634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:41.064934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:41.066301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:41.080128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 483/939] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Sep 6 04:10:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:41.081935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:41.087730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:41.088201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.088542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.088875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.089611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:41.089980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:41.091556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:41.123551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 457/940] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:41.171800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:41.207660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db89a-4a3c-4fc5-8709-d1377ef83aa3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:41.244165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:41.244803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.245074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.245338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.258196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:41.259714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:41.275692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:41.276754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:41.277657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:41.277657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:41.277657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:41.277657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 484/941] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:41.282946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:41.388994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832edf-a522-4430-82eb-286bc47c6a1f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:41.422561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:41.423671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.423943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.424206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.424838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:41.425133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:41.426484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:41.435729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:41.440968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 458/942] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:41.446621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:41.551238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b2399-72d4-41a6-84fd-7bceeaf14d94 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:41.575226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:41.587090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72435de-95e8-4697-a999-19fdd95053c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:41.590539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72435de-95e8-4697-a999-19fdd95053c5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.590539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72435de-95e8-4697-a999-19fdd95053c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.590539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72435de-95e8-4697-a999-19fdd95053c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.597086 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72435de-95e8-4697-a999-19fdd95053c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:41.598623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72435de-95e8-4697-a999-19fdd95053c5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a72435de-95e8-4697-a999-19fdd95053c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:41.610863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:41.611902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:41.612863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 485/943] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:10:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:41.619856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:41.728439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec4fae-0fb9-4dbe-a8f1-01dfdce34722 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:41.766397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ed93b-930c-41f7-ba13-527863db9f87 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.766760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ed93b-930c-41f7-ba13-527863db9f87 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.766971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ed93b-930c-41f7-ba13-527863db9f87 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.767539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:41.768434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.768609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 486/944] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:41.769086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.769555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.770489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:41.771004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:41.772672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:41.773550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1de9-de7a-4603-9c42-e84da412018c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.773833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1de9-de7a-4603-9c42-e84da412018c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.774106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1de9-de7a-4603-9c42-e84da412018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.792674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 459/945] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Sep 6 04:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:41.799407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ad2e1de9-de7a-4603-9c42-e84da412018c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:41.799563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:41.799646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ad2e1de9-de7a-4603-9c42-e84da412018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:41.862200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:41.876189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 487/946] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:41.906284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a5b0-5e17-49d8-ad7d-3f2d2cbe5ddb None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:41.941954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:41.942577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:41.942846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:41.943108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:41.953322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:41.954839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:41.969370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:41.970845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:41.971778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:41.971778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:41.971778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:41.971778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 460/947] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:41.977027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e1de9-de7a-4603-9c42-e84da412018c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:42.080825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e1de9-de7a-4603-9c42-e84da412018c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:42.095287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:42.118261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:42.118863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.119135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.119418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.120116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:42.120417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:42.121767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:42.133662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 488/948] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:42.139020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:42.158705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:42.261685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836921d-0994-43e5-b202-2ff7560aa043 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:42.262828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6638ac-282f-4f7f-8353-741eedabe4cf None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:42.276101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:42.302034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:42.303088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.303639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.304175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.305110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:42.305393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:42.306016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.306289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.306716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.308021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:42.315585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:42.317193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:42.318660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:42.319673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:42.320535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:42.327739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 489/949] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:42.330057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:42.330967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:42.331943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 461/950] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:42.332858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:42.337116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:42.392296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:42.455709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845bdb-a49e-4c50-88d9-51a1945bec14 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:42.472014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9351-23f7-46bb-86fc-6f50999a4667 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:42.492014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:42.493040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.493523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.494008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.494884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:42.495453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:42.497120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:42.503676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 490/951] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:42.511559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:42.516576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:42.517940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.518550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.519059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.520003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:42.520535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:42.522616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:42.539236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 462/952] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:42.544910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:42.584022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:42.625164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475695d-3082-466a-a7c2-1661385f3023 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:42.627916 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:42.659432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c248-7e0e-4398-a042-06f9031ae066 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:42.666096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b031-baac-4cae-ab49-c9608b83e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:42.666961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b031-baac-4cae-ab49-c9608b83e88d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.666961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b031-baac-4cae-ab49-c9608b83e88d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.667217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b031-baac-4cae-ab49-c9608b83e88d None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.667875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b031-baac-4cae-ab49-c9608b83e88d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:42.668172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b031-baac-4cae-ab49-c9608b83e88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:42.669518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b031-baac-4cae-ab49-c9608b83e88d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:42.674442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 491/953] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:42.675986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014b84-2701-47a3-aaf3-cfb4bc963667 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.676321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014b84-2701-47a3-aaf3-cfb4bc963667 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.676590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014b84-2701-47a3-aaf3-cfb4bc963667 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.679412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 492/954] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:42.683536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e90fb-3482-4328-af4e-3d12d745b4ee None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.684021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e90fb-3482-4328-af4e-3d12d745b4ee None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.684435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e90fb-3482-4328-af4e-3d12d745b4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.710368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-826e90fb-3482-4328-af4e-3d12d745b4ee None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:42.711998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-826e90fb-3482-4328-af4e-3d12d745b4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:42.714796 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:42.716712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:42.717106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:42.717513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/db6463c9c59e408e9d6c81065bae02e2/roles/e0097dc71a9f4d05b07f46f1bc332a18` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:42.720191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=db6463c9c59e408e9d6c81065bae02e2, role_id=e0097dc71a9f4d05b07f46f1bc332a18)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:42.722629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:42.742552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 463/955] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:10:42 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/db6463c9c59e408e9d6c81065bae02e2/roles/e0097dc71a9f4d05b07f46f1bc332a18 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:10:42.801244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 493/956] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:43.076613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:43.174650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:43.184427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67869b46-388b-40e6-bf01-3c7054deb0a7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:43.221273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b719637-3715-48e7-95aa-0229f23aea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:43.221916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b719637-3715-48e7-95aa-0229f23aea00 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:43.222231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b719637-3715-48e7-95aa-0229f23aea00 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:43.222456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b719637-3715-48e7-95aa-0229f23aea00 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:43.223042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b719637-3715-48e7-95aa-0229f23aea00 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:43.224445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b719637-3715-48e7-95aa-0229f23aea00 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2b719637-3715-48e7-95aa-0229f23aea00 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:43.233528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:43.234652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:43.236699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 464/957] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:43.241417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e90fb-3482-4328-af4e-3d12d745b4ee None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:43.339222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:43.345828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e90fb-3482-4328-af4e-3d12d745b4ee None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:43.366586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3abc5-ee88-46b1-a7f3-f6bcc5e9ed1a None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:43.367198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3abc5-ee88-46b1-a7f3-f6bcc5e9ed1a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:43.367198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3abc5-ee88-46b1-a7f3-f6bcc5e9ed1a None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:43.368730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 465/958] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:43.376818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0413a-61ab-4e56-a4fe-e240aaf4f537 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:43.377346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0413a-61ab-4e56-a4fe-e240aaf4f537 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:43.377814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0413a-61ab-4e56-a4fe-e240aaf4f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:43.394144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9555563-9550-4740-be1b-734d78362eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:43.394762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9555563-9550-4740-be1b-734d78362eca None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:43.395039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9555563-9550-4740-be1b-734d78362eca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:43.395312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9555563-9550-4740-be1b-734d78362eca None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:43.396067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9555563-9550-4740-be1b-734d78362eca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:43.396359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9555563-9550-4740-be1b-734d78362eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:43.398019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9555563-9550-4740-be1b-734d78362eca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:43.401296 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f9b0413a-61ab-4e56-a4fe-e240aaf4f537 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:43.403013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f9b0413a-61ab-4e56-a4fe-e240aaf4f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:43.403399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 494/959] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:43.409584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9555563-9550-4740-be1b-734d78362eca None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:43.476526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 466/960] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:43.520274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9555563-9550-4740-be1b-734d78362eca None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:43.555557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:43.556429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:43.556902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:43.557365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:43.558204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:43.558708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:43.560312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:43.565811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 495/961] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:43.573817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0413a-61ab-4e56-a4fe-e240aaf4f537 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:43.660370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:43.675998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0413a-61ab-4e56-a4fe-e240aaf4f537 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:43.711521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:43.712126 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:43.712397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:43.712662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:43.713329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:43.714693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:43.738154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 467/962] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:43.752956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:43.784912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:43.881331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d312ee-57ab-4b6a-9c2d-e64f2609c744 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:43.923968 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:43.924148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:43.924419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:43.924683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:43.925309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:43.926718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:43.929258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING keystone.server.flask.common [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 04:10:43.943649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.sql.core [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 04:10:43.943649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 04:10:43.943649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [parameters: {'user_id': '80cd7d6aeb3f41b6b849743e55d0768c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 04:10:43.943649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81626) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 06 04:10:43.951326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 04:10:43.952252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application yield resource Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise self.value Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application session.commit() Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 04:10:43.953239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.flush() Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application compat.raise_( Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 04:10:43.954678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 04:10:43.956638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 04:10:43.958401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [parameters: {'user_id': '80cd7d6aeb3f41b6b849743e55d0768c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:43.959423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 06 04:10:43.960440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 06 04:10:43.961830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 06 04:10:43.961830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 06 04:10:43.961830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 04:10:43.961830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 04:10:43.961830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 04:10:43.961830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:43.961830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 496/963] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Sep 6 04:10:43 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:43.962330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:44.069793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcac99-95b2-4840-aeee-650dc0e59f04 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:44.103990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d09b59-e4b0-4d8e-a04e-007c262f7f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:44.104620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09b59-e4b0-4d8e-a04e-007c262f7f43 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:44.104893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09b59-e4b0-4d8e-a04e-007c262f7f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:44.105162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09b59-e4b0-4d8e-a04e-007c262f7f43 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:44.112949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d09b59-e4b0-4d8e-a04e-007c262f7f43 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:44.114387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d09b59-e4b0-4d8e-a04e-007c262f7f43 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:44.116975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-43d09b59-e4b0-4d8e-a04e-007c262f7f43 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:44.126977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:44.128007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:44.128963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 468/964] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:44.138376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:44.225579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:44.246624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae72f7-80ad-4cb0-86ac-8e05836e5ece None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:44.284173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3097b0-f3cf-4e5d-8810-5d1c0bedc45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:44.284838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3097b0-f3cf-4e5d-8810-5d1c0bedc45e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:44.285120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3097b0-f3cf-4e5d-8810-5d1c0bedc45e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:44.285391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3097b0-f3cf-4e5d-8810-5d1c0bedc45e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:44.286154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3097b0-f3cf-4e5d-8810-5d1c0bedc45e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:44.286456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3097b0-f3cf-4e5d-8810-5d1c0bedc45e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:44.288209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3097b0-f3cf-4e5d-8810-5d1c0bedc45e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:44.329518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 497/965] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Sep 6 04:10:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:44.725401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c2070-eca0-4c50-a81a-f21222366702 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:44.725943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c2070-eca0-4c50-a81a-f21222366702 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:44.725943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c2070-eca0-4c50-a81a-f21222366702 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:44.727450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 469/966] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:44.730397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f428a9-92d6-4442-b58d-b438a55a4810 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:44.730928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f428a9-92d6-4442-b58d-b438a55a4810 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:44.731082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f428a9-92d6-4442-b58d-b438a55a4810 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:44.732005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95378da4-0ea9-4188-ad6c-10401663ef3c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:44.732288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95378da4-0ea9-4188-ad6c-10401663ef3c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:44.732682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 498/967] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:44.732786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95378da4-0ea9-4188-ad6c-10401663ef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:44.738053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4681681-2d69-45ee-8c66-8b6f3c4c3a45 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:44.738340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4681681-2d69-45ee-8c66-8b6f3c4c3a45 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:44.738614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4681681-2d69-45ee-8c66-8b6f3c4c3a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:44.751323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-95378da4-0ea9-4188-ad6c-10401663ef3c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:44.752534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-95378da4-0ea9-4188-ad6c-10401663ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:44.756477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d4681681-2d69-45ee-8c66-8b6f3c4c3a45 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:44.758285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d4681681-2d69-45ee-8c66-8b6f3c4c3a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:44.830404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 470/968] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:44.831561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 499/969] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:45.102010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95378da4-0ea9-4188-ad6c-10401663ef3c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:45.106669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4681681-2d69-45ee-8c66-8b6f3c4c3a45 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:45.183603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:45.206968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95378da4-0ea9-4188-ad6c-10401663ef3c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:45.215921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4681681-2d69-45ee-8c66-8b6f3c4c3a45 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:45.240975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:45.248167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:45.248754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.249002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.249301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.249899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:45.250502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.250812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.251086 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.251770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:45.253134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:45.261010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:45.266004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:45.267758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:45.268920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:45.279422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 471/970] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Sep 6 04:10:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:45.279422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:45.279725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 500/971] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:45 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:45.384634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151945-6eab-4c2f-844d-028097e7a4ed None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:45.429244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:45.429856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.430132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.430397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.431056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:45.431355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:45.432742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:45.441971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 472/972] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Sep 6 04:10:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:45.447776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:45.552987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cdc3-c8d6-4623-856e-04cb2cf7eac8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:45.581368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:45.589049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:45.590050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.590718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.591365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.601968 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:45.603445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:45.617279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:45.618252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:45.619166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:45.619166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:45.619166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:45.619166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 501/973] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:45.625187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:45.674754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:45.727621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7297e0-cbaa-4244-8276-7c4fc50b16c7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:45.761469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a6ae-b123-48a7-b0df-1f47ee75146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:45.762070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a6ae-b123-48a7-b0df-1f47ee75146f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.762341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a6ae-b123-48a7-b0df-1f47ee75146f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.762605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a6ae-b123-48a7-b0df-1f47ee75146f None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.763233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a6ae-b123-48a7-b0df-1f47ee75146f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:45.763558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a6ae-b123-48a7-b0df-1f47ee75146f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:45.764914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a6ae-b123-48a7-b0df-1f47ee75146f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:45.781809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 473/974] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:45.783361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:45.784199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41cb2c-ce5a-44ce-9313-dbde0558adfb None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.784446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41cb2c-ce5a-44ce-9313-dbde0558adfb None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.784716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41cb2c-ce5a-44ce-9313-dbde0558adfb None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.786143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 474/975] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:45.791039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca136-eeec-4a32-ae01-772518489b07 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.791314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca136-eeec-4a32-ae01-772518489b07 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.791616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca136-eeec-4a32-ae01-772518489b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.809622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-63dca136-eeec-4a32-ae01-772518489b07 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:45.811086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-63dca136-eeec-4a32-ae01-772518489b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:45.891410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 475/976] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:45.895105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97430b8d-48a6-4efa-8382-8678e6de3236 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:45.928358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:45.929008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:45.929285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:45.929552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:45.936857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:45.938853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:45.949665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:45.950590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:45.956631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 502/977] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:10:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:45.958440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dca136-eeec-4a32-ae01-772518489b07 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.009077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.069445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dca136-eeec-4a32-ae01-772518489b07 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.103633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.104230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.104509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.104778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.105491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:46.105793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.107219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.128987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 476/978] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Sep 6 04:10:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:46.130450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.158522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.176661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.243457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9765e-dd71-4630-be74-8229a2ecf610 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.258618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.265085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecfad-4777-42d9-bf42-3eacaf1b7907 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.281449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.282360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.282659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.282895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.301010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.301637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.301917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.302186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.302762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.304178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:46.313843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:46.314915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:46.315805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 477/979] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:46.321096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.367278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.368275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.415519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.433470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df470-22c2-4ed4-8192-a876ec2cc40e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.469674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.470273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.470553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.470821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.471479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:46.471784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.473145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.477900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 503/980] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:46.482683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 478/981] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:46.483301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.483743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.510983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.588299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7f2c1-cab0-4d4b-b00b-99fd6bc61273 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.594714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c28197-b3b8-48c4-8076-4eef94769c1a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.625360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.626550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.626825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.627092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.631180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.631815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.632091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.632604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.633227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:46.633526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.634911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.637914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.639452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.640199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 479/982] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:46.641608 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.645904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:46.656232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:46.657277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:46.658179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:46.658179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:46.658179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:46.658179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 504/983] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:46.662699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.743003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.758416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d302-b77e-44f8-bd49-9d8734cb1a49 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.769226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b32a38-f355-4a09-b047-33c5bf98edd6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.792309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.792998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.793279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.793547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.794245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] RBAC: Adding query filter params (interface=admin, service_id=45bf2a0af2c54d35a08405d94846158d, region_id=RegionOne) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:46.794551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.795960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.801923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 480/984] 10.222.0.18 () {56 vars in 1249 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/endpoints?service_id=45bf2a0af2c54d35a08405d94846158d&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:46.806870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.808629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.809246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.809526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.809818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.810510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:46.810816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.812241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.828234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 505/985] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:46.834180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:46.891572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:46.915133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdd89f-d11b-41fa-b269-57b6fc4b2b3d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.939657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17774a0-bb21-4e6f-a240-10b5f0b5771e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:46.950830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.951459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.951735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.952002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.952597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.954456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:46.960723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 481/986] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:10:46.977458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:46.978112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:46.978389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:46.978656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:46.992999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:46.994566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:47.008194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:47.009156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:47.014983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 506/987] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:47.015564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:47.036557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:47.128506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5fe89-5b8f-411d-afb7-f58cd706a6e4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:47.162719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494664-f8b5-4fb7-afdc-be557ff24cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:47.163243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494664-f8b5-4fb7-afdc-be557ff24cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:47.163551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494664-f8b5-4fb7-afdc-be557ff24cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:47.163823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494664-f8b5-4fb7-afdc-be557ff24cd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:47.164518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a494664-f8b5-4fb7-afdc-be557ff24cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:47.164822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a494664-f8b5-4fb7-afdc-be557ff24cd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:47.166258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a494664-f8b5-4fb7-afdc-be557ff24cd3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:47.179256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 482/988] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:47.185213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:47.196374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b25d8-e3f3-46f9-929f-689f314a850a None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:47.196822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b25d8-e3f3-46f9-929f-689f314a850a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:47.197102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b25d8-e3f3-46f9-929f-689f314a850a None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:47.198445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 483/989] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:47.204644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253604ad-992d-45ce-ad24-53415462b6e5 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:47.204927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253604ad-992d-45ce-ad24-53415462b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:47.205388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253604ad-992d-45ce-ad24-53415462b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:47.223112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-253604ad-992d-45ce-ad24-53415462b6e5 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:47.224367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-253604ad-992d-45ce-ad24-53415462b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:47.293633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319f35e-789c-4779-a92f-6921f9261d04 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:47.307135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 484/990] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:47.316146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:47.331651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:47.332250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:47.332524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:47.332790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:47.333528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] RBAC: Adding query filter params (role.id=e0097dc71a9f4d05b07f46f1bc332a18, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=db6463c9c59e408e9d6c81065bae02e2) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:47.333810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:47.335245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:47.347627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 507/991] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:47 2022] GET /identity/v3/role_assignments?user.id=db6463c9c59e408e9d6c81065bae02e2&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=e0097dc71a9f4d05b07f46f1bc332a18 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:47.579092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253604ad-992d-45ce-ad24-53415462b6e5 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:47.587406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:47.680065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253604ad-992d-45ce-ad24-53415462b6e5 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:47.713253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:47.713871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:47.714143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:47.714409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:47.714978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:47.716363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:47.725422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:47.726431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:47.728250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 485/992] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:47.733022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:47.834354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d4b30-f6a3-4f8b-be11-07511e08232c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:47.867822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:47.868425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:47.868698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:47.868962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:47.869581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:47.869880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:47.871230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:47.880681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 508/993] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:47.881894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:47.953950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:47.991667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0583-c6cf-432e-a205-b170effcdb78 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:48.028757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:48.029360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:48.029636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:48.029905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:48.030536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:48.030838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:48.032761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:48.042843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 486/994] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:48.044591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:48.089230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:48.148519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5110a8-ff01-4c5b-8f75-56febef94a1f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:48.181944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eee4a-9ed9-45a4-8fca-674ae874faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:48.182600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eee4a-9ed9-45a4-8fca-674ae874faff None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:48.182877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eee4a-9ed9-45a4-8fca-674ae874faff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:48.183191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eee4a-9ed9-45a4-8fca-674ae874faff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:48.183919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090eee4a-9ed9-45a4-8fca-674ae874faff None admin] RBAC: Adding query filter params (interface=public, service_id=37b27328400c41d180aaec65aa0211e3, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:48.184226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090eee4a-9ed9-45a4-8fca-674ae874faff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:48.185639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090eee4a-9ed9-45a4-8fca-674ae874faff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:48.198029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 509/995] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:10:48 2022] GET /identity/v3/endpoints?service_id=37b27328400c41d180aaec65aa0211e3&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:48.199682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:48.300299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff7a0-375a-45c8-a00e-fa2e69fa548c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:48.335279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcc58c-2e6f-4732-9ffd-33059ca654af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:48.335970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc58c-2e6f-4732-9ffd-33059ca654af None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:48.336254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc58c-2e6f-4732-9ffd-33059ca654af None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:48.336529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc58c-2e6f-4732-9ffd-33059ca654af None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:48.337239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcc58c-2e6f-4732-9ffd-33059ca654af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:48.338617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcc58c-2e6f-4732-9ffd-33059ca654af None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:48.339758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:48.346383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 487/996] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:48 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:10:48.894589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10577-9fed-4a01-9ea4-5c2c632c1256 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:48.895135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10577-9fed-4a01-9ea4-5c2c632c1256 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:48.895135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10577-9fed-4a01-9ea4-5c2c632c1256 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:48.896614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 510/997] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:48.901524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29257164-1e86-4e3a-90a4-7de50394d6cf None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:48.901903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29257164-1e86-4e3a-90a4-7de50394d6cf None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:48.902062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29257164-1e86-4e3a-90a4-7de50394d6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:48.920285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-29257164-1e86-4e3a-90a4-7de50394d6cf None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:48.921460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-29257164-1e86-4e3a-90a4-7de50394d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:48.999521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 488/998] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:49.262648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10577-9fed-4a01-9ea4-5c2c632c1256 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:49.273301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d9e8-0f39-45f2-960c-b62ac8868d93 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.273573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d9e8-0f39-45f2-960c-b62ac8868d93 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.273849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d9e8-0f39-45f2-960c-b62ac8868d93 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.275327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 489/999] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:49.279955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e45b-7699-4266-93c3-965d0f9893df None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.280234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e45b-7699-4266-93c3-965d0f9893df None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.280503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e45b-7699-4266-93c3-965d0f9893df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.300074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-ee21e45b-7699-4266-93c3-965d0f9893df None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:49.301520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ee21e45b-7699-4266-93c3-965d0f9893df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:49.373120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 490/1000] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:49.377859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10577-9fed-4a01-9ea4-5c2c632c1256 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:49.385717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:49.414051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:49.414686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.414962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.415230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.416012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:49.417432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:49.427286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:49.428429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:49.432441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 511/1001] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Sep 6 04:10:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:49.434541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e45b-7699-4266-93c3-965d0f9893df None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:49.495004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:49.539869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e45b-7699-4266-93c3-965d0f9893df None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:49.574331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:49.574932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.575211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.575514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.576137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:49.576439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:49.577806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:49.583441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 491/1002] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:49.589084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:49.643252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:49.695575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a428a-28dd-4941-bc76-5ee391d7e585 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:49.730981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:49.731615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.731948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.732224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.732852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:49.733154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:49.734513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:49.740261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 512/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Sep 6 04:10:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:49.745644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:49.752692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af78c9-9d31-46ed-a5cc-f86d6e129f25 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:49.776363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:49.783333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:49.789986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:49.790561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.790841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.791112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] PATH_INFO: `/v3/services/image` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.791732 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:49.793104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:49.802953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:49.804062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:49.808538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 492/1004] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Sep 6 04:10:49 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:49.810362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:49.859051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6092-f716-48b9-86e9-622e37931150 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:49.894490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:49.895092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.895654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.895654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.896572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:49.897759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:49.918133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 513/1005] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:49.920071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314f961-0660-4ae7-830e-511bc5156823 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:49.964805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd2b6d-c4b7-4d68-a289-68dead952edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:49.965423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2b6d-c4b7-4d68-a289-68dead952edb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:49.965698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2b6d-c4b7-4d68-a289-68dead952edb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:49.965967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2b6d-c4b7-4d68-a289-68dead952edb None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:49.966604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2b6d-c4b7-4d68-a289-68dead952edb None admin] RBAC: Adding query filter params (name=image) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:49.966901 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2b6d-c4b7-4d68-a289-68dead952edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:49.968343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2b6d-c4b7-4d68-a289-68dead952edb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:49.974719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 493/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:49.980313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:50.085804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:50.093756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ff4c8-8ff9-44c7-b347-6b9fb7bb4bf1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:50.130974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b29376-c8b3-4586-a0ba-0731ab9b096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:50.131617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29376-c8b3-4586-a0ba-0731ab9b096c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:50.131896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29376-c8b3-4586-a0ba-0731ab9b096c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:50.132164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29376-c8b3-4586-a0ba-0731ab9b096c None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:50.133087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29376-c8b3-4586-a0ba-0731ab9b096c None admin] RBAC: Adding query filter params (type=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:50.133387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29376-c8b3-4586-a0ba-0731ab9b096c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:50.134751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29376-c8b3-4586-a0ba-0731ab9b096c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:50.139473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 514/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:50.263741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e492-7ce2-4a4e-8b58-4e22c4aa61c5 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:50.264067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e492-7ce2-4a4e-8b58-4e22c4aa61c5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:50.264281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e492-7ce2-4a4e-8b58-4e22c4aa61c5 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:50.265786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 494/1008] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:50.271561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9de9c-aa2e-4ffc-952e-932c74367778 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:50.271561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9de9c-aa2e-4ffc-952e-932c74367778 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:50.271780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9de9c-aa2e-4ffc-952e-932c74367778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:50.291366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-07f9de9c-aa2e-4ffc-952e-932c74367778 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:50.292585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-07f9de9c-aa2e-4ffc-952e-932c74367778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:50.361537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 515/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:50.631342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258e492-7ce2-4a4e-8b58-4e22c4aa61c5 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:50.680114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:50.734551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258e492-7ce2-4a4e-8b58-4e22c4aa61c5 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:50.768459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:50.769077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:50.769350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:50.769617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:50.770190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:50.771567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:50.780108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:50.781067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 04:10:50.781976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:50.783748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 495/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:50.787025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9de9c-aa2e-4ffc-952e-932c74367778 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:50.873482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:50.887414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9de9c-aa2e-4ffc-952e-932c74367778 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:50.920824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:50.921439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:50.921690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:50.921948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:50.922592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:50.922891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:50.924264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:50.929440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 516/1011] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:50.934794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:51.046225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41005d75-cb3a-4196-aee4-ecfd4f91b3a3 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:51.056434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:51.081318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621b24-ef41-40a4-950f-890c7b9a9fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:51.081921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621b24-ef41-40a4-950f-890c7b9a9fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:51.082195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621b24-ef41-40a4-950f-890c7b9a9fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:51.082460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621b24-ef41-40a4-950f-890c7b9a9fc5 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:51.083078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621b24-ef41-40a4-950f-890c7b9a9fc5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:51.083397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621b24-ef41-40a4-950f-890c7b9a9fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:51.084762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621b24-ef41-40a4-950f-890c7b9a9fc5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:51.089991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 496/1012] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Sep 6 04:10:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:51.095337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:51.195175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8867c-db1d-40af-8e48-8092f05d8696 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:51.229588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53c5d1-14a1-41b2-a882-1467ae8ae925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:51.230188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53c5d1-14a1-41b2-a882-1467ae8ae925 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:51.230459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53c5d1-14a1-41b2-a882-1467ae8ae925 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:51.230723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53c5d1-14a1-41b2-a882-1467ae8ae925 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:51.231690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53c5d1-14a1-41b2-a882-1467ae8ae925 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:51.233049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53c5d1-14a1-41b2-a882-1467ae8ae925 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:51.253330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 517/1013] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:51.857566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e92cb-885d-44de-bf14-da0ac108edc9 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:51.857899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e92cb-885d-44de-bf14-da0ac108edc9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:51.858116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e92cb-885d-44de-bf14-da0ac108edc9 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:51.859620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 497/1014] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:51.865085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4a87-795f-4e6d-80ad-8385dbb89150 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:51.865380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4a87-795f-4e6d-80ad-8385dbb89150 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:51.865653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4a87-795f-4e6d-80ad-8385dbb89150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:51.884108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4f6f4a87-795f-4e6d-80ad-8385dbb89150 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:51.885295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f6f4a87-795f-4e6d-80ad-8385dbb89150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:51.887331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:51.965331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 518/1015] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:51 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:52.036805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753680b-6ca2-4b65-b912-50ce26127853 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:52.037253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753680b-6ca2-4b65-b912-50ce26127853 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:52.037413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753680b-6ca2-4b65-b912-50ce26127853 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:52.038873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 498/1016] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:52.043749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0b55b-da6c-4f93-9adb-cce239fef534 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:52.044036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0b55b-da6c-4f93-9adb-cce239fef534 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:52.044304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0b55b-da6c-4f93-9adb-cce239fef534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:52.062148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3bb0b55b-da6c-4f93-9adb-cce239fef534 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:52.063357 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3bb0b55b-da6c-4f93-9adb-cce239fef534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:52.128654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 519/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:52 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:52.232865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753680b-6ca2-4b65-b912-50ce26127853 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:52.336131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753680b-6ca2-4b65-b912-50ce26127853 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:52.370559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:52.371172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:52.371468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:52.371735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:52.372821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:52.374263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:52.376661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 499/1018] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:52.383448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0b55b-da6c-4f93-9adb-cce239fef534 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:52.394066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:52.448201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:52.456740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:52.501057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0b55b-da6c-4f93-9adb-cce239fef534 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:52.515830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50e1bc-7ccb-4ebf-af86-216e83e4c8e8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:52.537338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa03b8-8ec5-4927-bc3b-a08a1c24c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:52.537942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa03b8-8ec5-4927-bc3b-a08a1c24c4bf None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:52.538218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa03b8-8ec5-4927-bc3b-a08a1c24c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:52.538488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa03b8-8ec5-4927-bc3b-a08a1c24c4bf None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:52.539130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa03b8-8ec5-4927-bc3b-a08a1c24c4bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:52.540605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa03b8-8ec5-4927-bc3b-a08a1c24c4bf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:52.551276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12971ccf-6956-4e83-a641-e85be018e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:52.551895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971ccf-6956-4e83-a641-e85be018e5f2 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:52.552179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971ccf-6956-4e83-a641-e85be018e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:52.552498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971ccf-6956-4e83-a641-e85be018e5f2 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:52.553157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12971ccf-6956-4e83-a641-e85be018e5f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:52.554579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12971ccf-6956-4e83-a641-e85be018e5f2 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:52.579406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 520/1019] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:52 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:52.579644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 500/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:10:52 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:10:53.253880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bac57-9910-4468-a2d4-900389b58444 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:53.254383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bac57-9910-4468-a2d4-900389b58444 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:53.254383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bac57-9910-4468-a2d4-900389b58444 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:53.255881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 521/1021] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:53.260976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e457-4f80-40c2-b676-26d2aa3e88c4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:53.261370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e457-4f80-40c2-b676-26d2aa3e88c4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:53.261545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e457-4f80-40c2-b676-26d2aa3e88c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:53.279817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-db23e457-4f80-40c2-b676-26d2aa3e88c4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:53.280985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-db23e457-4f80-40c2-b676-26d2aa3e88c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:53.354706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 501/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:53.619858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bac57-9910-4468-a2d4-900389b58444 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:53.728914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bac57-9910-4468-a2d4-900389b58444 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:53.745589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:53.766054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:53.770113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:53.770113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:53.770113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:53.780755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:53.786345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:53.788564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:53.790663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:53.792449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 522/1023] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Sep 6 04:10:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:53.795265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23e457-4f80-40c2-b676-26d2aa3e88c4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:53.822807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:53.894786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23e457-4f80-40c2-b676-26d2aa3e88c4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:53.928393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:53.928988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:53.929317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:53.929586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:53.930260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:53.930561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:53.931959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:53.940130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 502/1024] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Sep 6 04:10:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:53.945445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:54.052359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186221aa-a68e-4486-b14b-c41394f594af None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:54.093460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:54.094094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.094883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.095154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.105529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:54.106979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:54.122167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:54.123168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:54.124106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:54.124106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:54.124106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:54.129693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 523/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:54.129819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:54.225229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:54.236540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cfcb4-bfbe-416a-9882-1f27de16d282 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:54.270460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:54.271781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.272202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.272646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.273420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:54.273866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:54.275390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:54.288424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 503/1026] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:54.293701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:54.322766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:54.402483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae856915-ba16-4340-b325-3cfaa37889df None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:54.440275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa14ff-8d61-49bc-95b4-58718564361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:54.441164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa14ff-8d61-49bc-95b4-58718564361c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.441590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa14ff-8d61-49bc-95b4-58718564361c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.442019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa14ff-8d61-49bc-95b4-58718564361c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.449640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa14ff-8d61-49bc-95b4-58718564361c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:54.451280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa14ff-8d61-49bc-95b4-58718564361c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-68fa14ff-8d61-49bc-95b4-58718564361c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:54.463262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:54.464423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:54.465675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 524/1027] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:10:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:54.471554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:54.516854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bfd49-0524-4f55-9145-a1d816315228 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.517046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bfd49-0524-4f55-9145-a1d816315228 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.517322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bfd49-0524-4f55-9145-a1d816315228 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.518774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 525/1028] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:54.523507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d9abb-4a3b-4bc7-898e-9d74053315b3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.523786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d9abb-4a3b-4bc7-898e-9d74053315b3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.524043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d9abb-4a3b-4bc7-898e-9d74053315b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.542209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a60d9abb-4a3b-4bc7-898e-9d74053315b3 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:54.543423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a60d9abb-4a3b-4bc7-898e-9d74053315b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:54.580100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb758-dd24-4a9b-8980-13568ebc72a0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:54.609003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 526/1029] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:54.610260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097b9f-5c61-4def-b25d-36932663a8d0 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.610541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097b9f-5c61-4def-b25d-36932663a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.610808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097b9f-5c61-4def-b25d-36932663a8d0 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.612068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 527/1030] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:54.615339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:54.615981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.616254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.616519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.617233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:54.617530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:54.618950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:54.620574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c419e-1027-4932-a9ac-6870cbd48b9d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.620858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c419e-1027-4932-a9ac-6870cbd48b9d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.621134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c419e-1027-4932-a9ac-6870cbd48b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.637513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 504/1031] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:10:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:54.642775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-505c419e-1027-4932-a9ac-6870cbd48b9d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:54.642775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-505c419e-1027-4932-a9ac-6870cbd48b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:54.643827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:54.655137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:54.656314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:54.715968 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 528/1032] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:54.762107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc041-f44a-4cf0-a838-2d4398363439 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:54.794949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:54.795499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:54.795775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:54.796039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:54.869245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:54.870703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:54.880789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:54.881519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c419e-1027-4932-a9ac-6870cbd48b9d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:54.980156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 505/1033] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 04:10:54.981171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:54.991933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c419e-1027-4932-a9ac-6870cbd48b9d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.026941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.027610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.027886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.028156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] PATH_INFO: `/v3/services/image` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.028736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.030096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:55.039424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:55.040526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:55.042000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 529/1034] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Sep 6 04:10:54 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:55.042822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.057395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.082009 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a89d4-6c41-4d52-a102-7a0be0752690 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.091094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.116342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.116975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.117254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.117524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.127253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.128742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.141057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81008fc6-da52-4849-959a-be793333fe36 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:55.144778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:55.145776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:55.146692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:55.146692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:55.146692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:55.146692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 506/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:55.147249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.176713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.177582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.177582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.177885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.178976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.180432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.181962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 530/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:55.182700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.245367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af73b50-eefe-48c7-aca8-4a0eff1153f0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.261652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.279786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.280387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.280668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.280938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.281382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8b82a-cba4-477e-a7ba-16a2c323bb49 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.281562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:55.281864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.283231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.288027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 507/1037] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:55.288790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.313848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.316946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.317553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.317830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.318097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.318735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:55.319036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.320440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.332575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 531/1038] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:55.333200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.392345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a46316-c452-4f8f-9e9b-51c47e6b34e7 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.426021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.426615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.426889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.427169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.427831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.429253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.430796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b894-43e9-41a7-ad7c-54d494ce7754 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.450587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 508/1039] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:10:55 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:55.451551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.477314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.478063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.478341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.478608 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.479364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] RBAC: Adding query filter params (type=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:55.479696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.481115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.492778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 532/1040] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:55.493928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.498691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.554587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.576365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd215-6ecf-4363-8675-b79adbccb418 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.614022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c1bb-de7f-4faf-a74e-a876f955947a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.620339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.620969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.621364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.621633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.628628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.630071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:55.642228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:55.643333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:55.644463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 509/1041] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:55.650538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.655878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.656496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.657362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.657627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.658329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] RBAC: Adding query filter params (interface=public, service_id=5a7d71ae4b0b490d9da4e6062d95f762, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:55.658637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.660038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.668315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 533/1042] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/endpoints?service_id=5a7d71ae4b0b490d9da4e6062d95f762&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:55.674285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.745257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.762473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c9575-4cfc-4432-bafc-1f00fc3587d0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.787753 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282726a8-b3f5-4590-84d4-0cf081e2f08a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.801641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.802617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.803039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.803309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.804013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:55.804328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.805839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.816007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:55.824347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 510/1043] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:55.824524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca1075-0c36-4e4f-bf72-b61701a76aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.824524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca1075-0c36-4e4f-bf72-b61701a76aaf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.824524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca1075-0c36-4e4f-bf72-b61701a76aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.824524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca1075-0c36-4e4f-bf72-b61701a76aaf None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.824796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca1075-0c36-4e4f-bf72-b61701a76aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.825470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:55.825640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca1075-0c36-4e4f-bf72-b61701a76aaf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.833269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 534/1044] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:10:55.943727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018aeb0-1393-4a25-b85a-173fb3639818 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:55.985911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c4331-c1b1-4d62-978c-33d763fd1c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:55.985911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4331-c1b1-4d62-978c-33d763fd1c92 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:55.985911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4331-c1b1-4d62-978c-33d763fd1c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:55.985911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4331-c1b1-4d62-978c-33d763fd1c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:55.986390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c4331-c1b1-4d62-978c-33d763fd1c92 None admin] RBAC: Adding query filter params (role.id=e0097dc71a9f4d05b07f46f1bc332a18, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=88339d0387834b8b8e833579efd7ee96) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:55.986390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c4331-c1b1-4d62-978c-33d763fd1c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:55.987179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c4331-c1b1-4d62-978c-33d763fd1c92 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:55.993816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 511/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:55 2022] GET /identity/v3/role_assignments?user.id=88339d0387834b8b8e833579efd7ee96&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=e0097dc71a9f4d05b07f46f1bc332a18 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:57.432773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da977ec6-0bed-4f93-b805-909f3262b141 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:57.433283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da977ec6-0bed-4f93-b805-909f3262b141 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:57.433283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da977ec6-0bed-4f93-b805-909f3262b141 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:57.434604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 535/1046] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:57.439926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9ca0-f6b2-49ad-aa8e-2d5b5ca4e565 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:57.440336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9ca0-f6b2-49ad-aa8e-2d5b5ca4e565 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:57.440425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9ca0-f6b2-49ad-aa8e-2d5b5ca4e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:57.458999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0b7b9ca0-f6b2-49ad-aa8e-2d5b5ca4e565 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:57.460225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0b7b9ca0-f6b2-49ad-aa8e-2d5b5ca4e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:57.519709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:57.529257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 512/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:10:57.760544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d88e86-3c11-40e6-bb56-a8b2c1512c7f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:57.760941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d88e86-3c11-40e6-bb56-a8b2c1512c7f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:57.761118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d88e86-3c11-40e6-bb56-a8b2c1512c7f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:57.762551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 536/1048] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:10:57.768238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11ae5-f95b-4e02-9ed9-5467120356f2 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:57.768584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11ae5-f95b-4e02-9ed9-5467120356f2 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:57.768879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11ae5-f95b-4e02-9ed9-5467120356f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:57.787908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b6b11ae5-f95b-4e02-9ed9-5467120356f2 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:57.789884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b6b11ae5-f95b-4e02-9ed9-5467120356f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:57.804891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d88e86-3c11-40e6-bb56-a8b2c1512c7f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:57.859558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 513/1049] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:57.905583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696258-dbe6-4604-8bea-65909801d9b3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:57.905876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696258-dbe6-4604-8bea-65909801d9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:57.906140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696258-dbe6-4604-8bea-65909801d9b3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:57.907551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 514/1050] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:10:57.911222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d88e86-3c11-40e6-bb56-a8b2c1512c7f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:57.912254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a958e95-35ae-4d7b-8d2a-435c8e25ae16 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:57.912541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a958e95-35ae-4d7b-8d2a-435c8e25ae16 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:57.912820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a958e95-35ae-4d7b-8d2a-435c8e25ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:57.930946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1a958e95-35ae-4d7b-8d2a-435c8e25ae16 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:10:57.932167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1a958e95-35ae-4d7b-8d2a-435c8e25ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:10:57.943794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:57.948768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:57.949796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:57.950517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:57.950700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:57.960930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:57.965711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:57.966620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:57.967970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 537/1051] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:57.972747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.013833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 515/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:10:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:10:58.076297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa6f84-a86d-491c-bf66-9c230fbc9d9d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.109547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.110723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.110997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.111284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.111949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:58.112247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.113606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.128561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 538/1053] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:58.132250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a958e95-35ae-4d7b-8d2a-435c8e25ae16 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.133666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.189297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.190180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.235496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a958e95-35ae-4d7b-8d2a-435c8e25ae16 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.238764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff34e0-76d2-4d45-b444-05eded7ff7f3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.269701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.270250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.270523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.270789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] PATH_INFO: `/v3/users/e2e1b8076e3648508cf4710f2698ae67` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.272282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.272902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.273177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.273451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.274023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.275386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.284535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1b8076e3648508cf4710f2698ae67)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:58.284850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:58.285874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 04:10:58.286733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:58.287524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.287600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 539/1054] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:58.289559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.292427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 516/1055] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/users/e2e1b8076e3648508cf4710f2698ae67 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:58.293092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.390567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11735a-9956-4a87-aa2a-3d49de1feac5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.391092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d05d3-03b3-461d-9bd0-7bcfab7b960a None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.404032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.407810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.425926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.426227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.426552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.426818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.426910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.427087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.427175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.427351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.427995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] RBAC: Adding query filter params (name=image) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:58.428290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.429644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.439471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 517/1056] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:58.439471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.439719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:10:58.442480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:58.443544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 540/1057] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:58.445805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.540849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5cc0-5959-40e3-b73e-8cffbac5f191 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.544877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac627-0cf0-4e3b-9904-28f31d831adf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.573667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.574257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.574529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.574793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.578417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.579040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.579320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.579618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.580245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] RBAC: Adding query filter params (type=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:58.580547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.581899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.586641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 541/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:58.587434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.620558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.629946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.643718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.645160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.686843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37847-63de-45e4-a017-e7abda9f2d19 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.720999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.721876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.722175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.722441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.723100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:58.723429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.724788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.732600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 542/1059] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:58.733344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.753333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 518/1060] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:10:58.753333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.828326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.831074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f9fa-2e73-49f7-8441-0366d05cc667 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.834141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:58.851694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731d379-278a-4411-818d-43bcaf0bd266 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:58.865937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.866556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.866829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.867091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.867775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.869119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.886157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:58.886782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:58.887057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:58.887323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:58.888471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 543/1061] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:10:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:10:58.889267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:58.905993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:58.908681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:58.925430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:58.926539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:58.928467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:58.928467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:58.928467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:58.928467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 519/1062] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:58.932523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.020408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1bf64-963a-46b6-b411-6335826d218a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.052776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecf9cd-e023-4abd-9e2a-686fd9edbce9 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.062517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.064120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.064242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.064427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.065572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=75ac398df2294ab8b320f1c7d8839721)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.066997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.068700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 544/1063] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:59.074785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.082731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:59.093831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.094442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.094716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.094995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.095663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:59.095965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.097345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.102943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:59.109649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 520/1064] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:59.115016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.191635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5ef9-5fe5-4232-827f-55f399756cb6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.224601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a66a0-58e4-454d-880c-ec44faa90848 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.231353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.231983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.232255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.232521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.233750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=75ac398df2294ab8b320f1c7d8839721, user.id=e2e1b8076e3648508cf4710f2698ae67) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:59.234054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.235874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.242007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 545/1065] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:10:59 2022] GET /identity/v3/role_assignments?user.id=e2e1b8076e3648508cf4710f2698ae67&scope.project.id=75ac398df2294ab8b320f1c7d8839721&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:59.269308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.269960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.270237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.270508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.278798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.280290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:10:59.293808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:59.294817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:10:59.296381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:59.297339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 521/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:10:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:10:59.301679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.400084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:59.413253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de1ec-f9e3-462a-9e34-8e663de1abe9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.445703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.446322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.446568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.446825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.447568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:59.447871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.449280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.471983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 546/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:10:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:10:59.473583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.524318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:59.576875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70f274-2231-425f-babf-68c7656bd73b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.610364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.610978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.611248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.611543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.622038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.623501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:10:59.637484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:59.638420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:10:59.639314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:10:59.639314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:10:59.639314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:59.643436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 522/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:59.645283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.746844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684df538-c7e2-435a-82d4-5e666a5def38 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.781106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12962-3906-4943-bbd5-98618885173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.781734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12962-3906-4943-bbd5-98618885173f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.782006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12962-3906-4943-bbd5-98618885173f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.782271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12962-3906-4943-bbd5-98618885173f None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.782901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12962-3906-4943-bbd5-98618885173f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:10:59.783196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12962-3906-4943-bbd5-98618885173f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.784579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12962-3906-4943-bbd5-98618885173f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.795651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 547/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:10:59.801064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.899534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:10:59.903363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20086e51-fbd2-4d97-b7e4-b6a202e1a715 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:10:59.936976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:10:59.937684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:10:59.938541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:10:59.938870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:10:59.945463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:10:59.946992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:10:59.958454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:10:59.959630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:10:59.960756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:10:59.961286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 523/1070] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:10:59.967252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12962-3906-4943-bbd5-98618885173f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:10:59.976847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:00.079860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12962-3906-4943-bbd5-98618885173f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:00.112624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da752b-8582-466d-9588-7095d16d182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:00.113217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da752b-8582-466d-9588-7095d16d182a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:00.113490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da752b-8582-466d-9588-7095d16d182a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:00.113755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da752b-8582-466d-9588-7095d16d182a None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:00.114429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da752b-8582-466d-9588-7095d16d182a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:00.114728 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da752b-8582-466d-9588-7095d16d182a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:00.116160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da752b-8582-466d-9588-7095d16d182a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:00.128742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 548/1071] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:00.134746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:00.233371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb125-da9d-4c63-b3ef-685a06943fa8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:00.267560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe3d57-e605-48db-be3d-1c090dd47365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:00.268130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3d57-e605-48db-be3d-1c090dd47365 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:00.268407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3d57-e605-48db-be3d-1c090dd47365 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:00.268674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3d57-e605-48db-be3d-1c090dd47365 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/88339d0387834b8b8e833579efd7ee96/roles/e0097dc71a9f4d05b07f46f1bc332a18` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:00.270764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe3d57-e605-48db-be3d-1c090dd47365 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=88339d0387834b8b8e833579efd7ee96, role_id=e0097dc71a9f4d05b07f46f1bc332a18)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:00.272232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe3d57-e605-48db-be3d-1c090dd47365 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:00.285595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 524/1072] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:11:00 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/88339d0387834b8b8e833579efd7ee96/roles/e0097dc71a9f4d05b07f46f1bc332a18 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:11:00.830164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73a25e-7439-4028-985e-19b49770293c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:00.830683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73a25e-7439-4028-985e-19b49770293c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:00.830683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73a25e-7439-4028-985e-19b49770293c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:00.832214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 549/1073] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:00.837114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade5cdb-b8c3-4106-b280-09aa2a508c1a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:00.837487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade5cdb-b8c3-4106-b280-09aa2a508c1a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:00.837669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade5cdb-b8c3-4106-b280-09aa2a508c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:00.856100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9ade5cdb-b8c3-4106-b280-09aa2a508c1a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:00.857294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9ade5cdb-b8c3-4106-b280-09aa2a508c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:00.871734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:00.927337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 525/1074] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:01.132083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79d15a-f397-4a9e-9e19-32261af3ceab None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:01.132718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79d15a-f397-4a9e-9e19-32261af3ceab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:01.132840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79d15a-f397-4a9e-9e19-32261af3ceab None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:01.134319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 550/1075] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:01.139203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8b1a-dea3-498c-8753-909ab0327774 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:01.139531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8b1a-dea3-498c-8753-909ab0327774 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:01.139809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8b1a-dea3-498c-8753-909ab0327774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:01.159427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-805c8b1a-dea3-498c-8753-909ab0327774 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:01.160602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-805c8b1a-dea3-498c-8753-909ab0327774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:01.192050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79d15a-f397-4a9e-9e19-32261af3ceab None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:01.233878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 526/1076] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:01.266801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:01.303167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79d15a-f397-4a9e-9e19-32261af3ceab None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:01.339029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:01.339660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:01.339940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:01.340208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:01.410752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:01.412227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:01.473672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:01.503598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c8b1a-dea3-498c-8753-909ab0327774 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:01.511096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 551/1077] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 04:11:01.517464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:01.590607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:01.610761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c8b1a-dea3-498c-8753-909ab0327774 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:01.625990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394a91f-120d-4936-bf31-60d01f83577c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:01.647300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:01.647968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:01.648243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:01.648788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:01.659105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:01.662551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:01.663121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:01.663424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:01.663700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:01.663897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:01.664820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:11:01.665658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 527/1078] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:11:01.670838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:01.680566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:01.682021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:11:01.698832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:01.700119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:11:01.701018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:11:01.701018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:11:01.701018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:01.701018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 552/1079] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:11:01.705746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:01.725030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:01.778001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a85b5-a30c-4b5b-b6ec-b4a8afecc946 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:01.817062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:01.817668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:01.817942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:01.818212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:01.818872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:01.819170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:01.820586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:01.822497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1dcf1-2a26-4667-b2f9-f796614df858 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:01.829030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 528/1080] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:11:01.834638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:01.837366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:01.863742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:01.864443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:01.864732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:01.865002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:01.865642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:01.865952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:01.867307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:01.880022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 553/1081] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:01.956334 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab22c-9096-4faa-97d2-53c560f08f66 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:02.003675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:02.004322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:02.004602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:02.004871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] PATH_INFO: `/v3/users/e2e1b8076e3648508cf4710f2698ae67` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:02.006035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1b8076e3648508cf4710f2698ae67)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:02.007778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:02.014174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 529/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:01 2022] GET /identity/v3/users/e2e1b8076e3648508cf4710f2698ae67 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:11:02.015200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:02.101542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:02.124178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8b33-153d-4979-9dcc-cc1a3a71a9ff None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:02.160628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6395577-47dc-4b3c-b1a6-a22eac026d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:02.161260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395577-47dc-4b3c-b1a6-a22eac026d31 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:02.161539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395577-47dc-4b3c-b1a6-a22eac026d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:02.161809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395577-47dc-4b3c-b1a6-a22eac026d31 None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:02.162918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6395577-47dc-4b3c-b1a6-a22eac026d31 None admin] RBAC: Authorizing `identity:get_project(project_id=75ac398df2294ab8b320f1c7d8839721)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:02.164367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6395577-47dc-4b3c-b1a6-a22eac026d31 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:02.166313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 554/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:02 2022] GET /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:02.172068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:02.217424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55529e3-e097-4547-813e-12611b9d9fe3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:02.217617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55529e3-e097-4547-813e-12611b9d9fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:02.217943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55529e3-e097-4547-813e-12611b9d9fe3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:02.219337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 555/1084] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:11:02.224306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c159b-f325-4d4c-9e94-4cc93220d7bd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:02.224585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c159b-f325-4d4c-9e94-4cc93220d7bd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:02.224854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c159b-f325-4d4c-9e94-4cc93220d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:02.242509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-993c159b-f325-4d4c-9e94-4cc93220d7bd None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:02.243498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:02.243755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-993c159b-f325-4d4c-9e94-4cc93220d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:02.276472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0ea83-d8a5-4d2a-bbca-de8e4bbc7762 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:02.311214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:02.315402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 556/1085] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:11:02.315565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:02.315565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:02.315565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721/users/e2e1b8076e3648508cf4710f2698ae67/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:02.315565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] RBAC: Authorizing `identity:create_grant(project_id=75ac398df2294ab8b320f1c7d8839721, user_id=e2e1b8076e3648508cf4710f2698ae67, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:02.316260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:02.328312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 530/1086] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:11:02 2022] PUT /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721/users/e2e1b8076e3648508cf4710f2698ae67/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:11:02.582520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c159b-f325-4d4c-9e94-4cc93220d7bd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:02.655985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:02.678547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c159b-f325-4d4c-9e94-4cc93220d7bd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:02.711195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:02.711955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:02.712229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:02.712492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:02.722738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:02.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:02.728618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:02.729505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 557/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Sep 6 04:11:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:02.734557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:02.845051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8ac82-5cea-4039-86e8-9e2866991a24 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:02.873001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:02.879980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:02.880646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:02.880924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:02.881189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:02.881842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:02.882138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:02.883783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:02.891521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 531/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Sep 6 04:11:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:02.897324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:02.995109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0561015-8ac3-4e6e-8612-d4fb241c7a40 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:03.028356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:03.029034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:03.029314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:03.029584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:03.032707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:03.040919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:03.042358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:11:03.057126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:03.058055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:11:03.059306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:11:03.059306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:11:03.059306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:03.059306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 558/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:03.064161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:03.161997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7443-b48b-42d7-918e-07020e73fe76 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:03.194304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:03.194897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:03.195172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:03.195469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:03.196098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:03.196395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:03.197748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:03.209914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 532/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:03.215272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:03.312559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a54d-d3e0-45a4-ac4b-10248b0b145d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:03.345493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:03.346110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:03.346388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:03.346656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:03.353830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:03.355247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:11:03.366740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:03.367856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:03.368790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 559/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Sep 6 04:11:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:03.373922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:03.425534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:03.473102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da9377-c637-4d14-b796-a3dff1ce333b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:03.506822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:03.507687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:03.507967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:03.508233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:03.508941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:03.509239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:03.510678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:03.527843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 533/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Sep 6 04:11:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:03.533396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:03.581307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:03.630992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bd256-c8d1-48bb-995c-5c7bfa4dd11e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:03.663942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:03.664538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:03.664815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:03.665086 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:03.730842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:03.732321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:03.778593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:03.830339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 560/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:03.836076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:03.933225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7853c51-f605-4e1c-ab2b-78e608dcbd84 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:03.943992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:03.967178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:03.967898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:03.968175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:03.968443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:03.978137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:03.979606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:11:03.994492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:03.995453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:11:03.996358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:11:03.996358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:11:03.996358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:11:03.999653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 534/1094] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:04.001801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:04.096558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165453e2-57e4-422a-a4db-4afff75c7d31 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:04.129832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0f108-20b9-4e9e-9cd3-31f51026e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:04.130426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f108-20b9-4e9e-9cd3-31f51026e32a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.130702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f108-20b9-4e9e-9cd3-31f51026e32a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.130972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f108-20b9-4e9e-9cd3-31f51026e32a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.131634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0f108-20b9-4e9e-9cd3-31f51026e32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:04.131937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0f108-20b9-4e9e-9cd3-31f51026e32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:04.133543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0f108-20b9-4e9e-9cd3-31f51026e32a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:04.144504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 561/1095] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:11:04.150025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:04.204051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ad73d-c41a-44cb-83a8-434e13f0f7e7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.204331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ad73d-c41a-44cb-83a8-434e13f0f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.204610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ad73d-c41a-44cb-83a8-434e13f0f7e7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.205953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 562/1096] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:11:04.210760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05be50-9a1f-4acf-ac47-fddfd6a3ccba None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.211042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05be50-9a1f-4acf-ac47-fddfd6a3ccba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.211318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05be50-9a1f-4acf-ac47-fddfd6a3ccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.229398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0b05be50-9a1f-4acf-ac47-fddfd6a3ccba None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:04.230585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0b05be50-9a1f-4acf-ac47-fddfd6a3ccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:04.232566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:04.255282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95640-f1db-4588-b117-aaf855746a12 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:04.289032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:04.289656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.289932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.290301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.296762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:04.298515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 563/1097] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:11:04.298825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:11:04.310717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:04.311830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:11:04.312974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 535/1098] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:11:04.317444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05be50-9a1f-4acf-ac47-fddfd6a3ccba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:04.411958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05be50-9a1f-4acf-ac47-fddfd6a3ccba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:04.444486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:04.445074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.445350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.445620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.446298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:04.446599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:04.448045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:04.454477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:04.461024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 564/1099] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:04.465821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:04.493299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:04.566621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8d5e-8868-4738-89e9-e9aefca0b319 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:04.574380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:04.601664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:04.602260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.602535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.602818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.603578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] RBAC: Adding query filter params (role.id=e0097dc71a9f4d05b07f46f1bc332a18, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=88339d0387834b8b8e833579efd7ee96) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:04.603882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:04.605312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:04.612478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 536/1100] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:04 2022] GET /identity/v3/role_assignments?user.id=88339d0387834b8b8e833579efd7ee96&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=e0097dc71a9f4d05b07f46f1bc332a18 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:04.679445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2f01b-1839-4c58-a46c-b0c019eabc58 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:04.714717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:04.715359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.715666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.715938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.728065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:04.732963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:04.734051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:04.734897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 565/1101] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:11:04.740259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:04.827858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:04.844933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56c46e-043c-413c-a577-39c3b1fc56b5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:04.879533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:04.880148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:04.880423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:04.880687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:04.881398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:04.881641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:04.883271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:04.892715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 537/1102] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:11:04.901007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:04.962292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:05.007084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da8c7d-0345-45c6-bc3c-54ef786c4e59 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:05.041905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:05.042531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:05.042805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:05.043071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] PATH_INFO: `/v3/users/e2e1b8076e3648508cf4710f2698ae67` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:05.044214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1b8076e3648508cf4710f2698ae67)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:05.045640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:05.047241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 566/1103] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:04 2022] GET /identity/v3/users/e2e1b8076e3648508cf4710f2698ae67 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:05.053613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:05.156036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1332d5-f64e-41b8-a330-7f4f6f3d5979 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:05.191197 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:05.191832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:05.192113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:05.192384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:05.210690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:05.261053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:05.262526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:05.361216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 538/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:05.367310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:05.472584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9abc4c-ec27-4cf3-bab7-8453c1dbad8b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:05.497323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:05.506761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7c81-6b92-4f77-844a-5998d74032f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:05.507643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7c81-6b92-4f77-844a-5998d74032f8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:05.507930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7c81-6b92-4f77-844a-5998d74032f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:05.508197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7c81-6b92-4f77-844a-5998d74032f8 None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:05.509297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b7c81-6b92-4f77-844a-5998d74032f8 None admin] RBAC: Authorizing `identity:get_project(project_id=75ac398df2294ab8b320f1c7d8839721)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:05.510713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b7c81-6b92-4f77-844a-5998d74032f8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:05.512383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 567/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:05 2022] GET /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:05.518500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:05.566202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:05.614175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140db28-fd50-4f1d-a81e-10546da86497 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:05.647218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6c67f-a313-42e4-84bf-476620abac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:05.647826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c67f-a313-42e4-84bf-476620abac78 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:05.648097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c67f-a313-42e4-84bf-476620abac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:05.648361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c67f-a313-42e4-84bf-476620abac78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:05.649062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6c67f-a313-42e4-84bf-476620abac78 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=75ac398df2294ab8b320f1c7d8839721, user.id=e2e1b8076e3648508cf4710f2698ae67) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:05.649363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6c67f-a313-42e4-84bf-476620abac78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:05.650763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6c67f-a313-42e4-84bf-476620abac78 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:05.656265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 539/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:05 2022] GET /identity/v3/role_assignments?user.id=e2e1b8076e3648508cf4710f2698ae67&scope.project.id=75ac398df2294ab8b320f1c7d8839721&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:07.575718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203807-6f70-4c59-b61b-7e235059a187 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:07.576269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203807-6f70-4c59-b61b-7e235059a187 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:07.576269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203807-6f70-4c59-b61b-7e235059a187 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:07.577580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 568/1107] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:07.583329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ea74-fbf8-42fe-b089-b1f6e3e8b290 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:07.583715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ea74-fbf8-42fe-b089-b1f6e3e8b290 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:07.583885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ea74-fbf8-42fe-b089-b1f6e3e8b290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:07.601426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6bf0ea74-fbf8-42fe-b089-b1f6e3e8b290 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:07.602607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6bf0ea74-fbf8-42fe-b089-b1f6e3e8b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:07.666702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 540/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:07.944863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203807-6f70-4c59-b61b-7e235059a187 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:08.042058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203807-6f70-4c59-b61b-7e235059a187 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:08.074065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331f93c-67bf-4b5d-829e-93d01381dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:08.074669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f93c-67bf-4b5d-829e-93d01381dd17 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:08.074941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f93c-67bf-4b5d-829e-93d01381dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:08.075210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f93c-67bf-4b5d-829e-93d01381dd17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:08.076335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331f93c-67bf-4b5d-829e-93d01381dd17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:08.077742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331f93c-67bf-4b5d-829e-93d01381dd17 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:08.079298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 569/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:08.085098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ea74-fbf8-42fe-b089-b1f6e3e8b290 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:08.126843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:08.181440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ea74-fbf8-42fe-b089-b1f6e3e8b290 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:08.213356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450251-51d1-4374-a15a-1a543f842cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:08.213883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450251-51d1-4374-a15a-1a543f842cec None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:08.214161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450251-51d1-4374-a15a-1a543f842cec None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:08.214429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450251-51d1-4374-a15a-1a543f842cec None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:08.215074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450251-51d1-4374-a15a-1a543f842cec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:08.216526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450251-51d1-4374-a15a-1a543f842cec None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:08.238963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 541/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:11:08 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:11:10.178493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59248f92-b899-429f-b438-794f53ce405c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:10.179011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59248f92-b899-429f-b438-794f53ce405c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:10.179011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59248f92-b899-429f-b438-794f53ce405c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:10.180384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 570/1111] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:10.185442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cd9ff-3b17-4dd3-acc2-1d197bfe778e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:10.185868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cd9ff-3b17-4dd3-acc2-1d197bfe778e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:10.185994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cd9ff-3b17-4dd3-acc2-1d197bfe778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:10.204344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-748cd9ff-3b17-4dd3-acc2-1d197bfe778e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:10.205529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-748cd9ff-3b17-4dd3-acc2-1d197bfe778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:10.269752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 542/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:10.537427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59248f92-b899-429f-b438-794f53ce405c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:10.598043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:10.640396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59248f92-b899-429f-b438-794f53ce405c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:10.673876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:10.674493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:10.674773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:10.675045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] PATH_INFO: `/v3/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:10.676454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] RBAC: Authorizing `identity:get_role(role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:10.677820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:10.679127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 571/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:10 2022] GET /identity/v3/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:10.684842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cd9ff-3b17-4dd3-acc2-1d197bfe778e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:10.711867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:10.782535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cd9ff-3b17-4dd3-acc2-1d197bfe778e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:10.814539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:10.815094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:10.815397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:10.815674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] PATH_INFO: `/v3/users/f2c2059262b54d3597d4b1072b58971a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:10.828710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c2059262b54d3597d4b1072b58971a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:10.830146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:10.831766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 543/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:10 2022] GET /identity/v3/users/f2c2059262b54d3597d4b1072b58971a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:10.837326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:10.935163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af57c09-2969-445a-b6b4-f8bfffe249d0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:10.962700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:10.968705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:10.969932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:10.970205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:10.970470 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:11.036799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:11.038232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:11.131325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 572/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:11.137419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:11.226030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:11.240870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd4d0-81ae-4ce4-84e4-61e98697b6e2 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:11.274380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d6c0b-872a-4833-b0eb-8015e74d5110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:11.274993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d6c0b-872a-4833-b0eb-8015e74d5110 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:11.275269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d6c0b-872a-4833-b0eb-8015e74d5110 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:11.275566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d6c0b-872a-4833-b0eb-8015e74d5110 None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:11.276663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d6c0b-872a-4833-b0eb-8015e74d5110 None admin] RBAC: Authorizing `identity:get_project(project_id=75ac398df2294ab8b320f1c7d8839721)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:11.278080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d6c0b-872a-4833-b0eb-8015e74d5110 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:11.279730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 544/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:11 2022] GET /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:11.285895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:11.314469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:11.381511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44ab36-5acf-48cc-81e6-ee6e7ddfeb1d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:11.413552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11210624-ae1b-445c-87af-c0824714f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:11.414133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210624-ae1b-445c-87af-c0824714f770 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:11.414405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210624-ae1b-445c-87af-c0824714f770 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:11.414669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210624-ae1b-445c-87af-c0824714f770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:11.415405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11210624-ae1b-445c-87af-c0824714f770 None admin] RBAC: Adding query filter params (role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=75ac398df2294ab8b320f1c7d8839721, user.id=f2c2059262b54d3597d4b1072b58971a) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:11.415707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11210624-ae1b-445c-87af-c0824714f770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:11.417105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11210624-ae1b-445c-87af-c0824714f770 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:11.422743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 573/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:11 2022] GET /identity/v3/role_assignments?user.id=f2c2059262b54d3597d4b1072b58971a&scope.project.id=75ac398df2294ab8b320f1c7d8839721&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:13.299891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a465c-7c05-45a8-94a8-6736f1dd7a68 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:13.300457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a465c-7c05-45a8-94a8-6736f1dd7a68 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:13.300457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a465c-7c05-45a8-94a8-6736f1dd7a68 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:13.301687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 545/1118] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:13.306878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a510c87-7879-473c-9d44-84f274505396 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:13.307305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a510c87-7879-473c-9d44-84f274505396 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:13.307473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a510c87-7879-473c-9d44-84f274505396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:13.325618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2a510c87-7879-473c-9d44-84f274505396 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:13.326794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a510c87-7879-473c-9d44-84f274505396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:13.390183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 574/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:13.656715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a465c-7c05-45a8-94a8-6736f1dd7a68 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:13.753973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a465c-7c05-45a8-94a8-6736f1dd7a68 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:13.785962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:13.786560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:13.786832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:13.787099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] PATH_INFO: `/v3/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:13.788492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] RBAC: Authorizing `identity:get_role(role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:13.789876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:13.791151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 546/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:13 2022] GET /identity/v3/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:13.797269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a510c87-7879-473c-9d44-84f274505396 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:13.821250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:13.895858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a510c87-7879-473c-9d44-84f274505396 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:13.928043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:13.928596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:13.928868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:13.929136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] PATH_INFO: `/v3/users/f2c2059262b54d3597d4b1072b58971a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:13.930219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c2059262b54d3597d4b1072b58971a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:13.931655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:13.933202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 575/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:13 2022] GET /identity/v3/users/f2c2059262b54d3597d4b1072b58971a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:13.939689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:13.964543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:14.038080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07698a-9523-4d54-8415-ac29c018c3c3 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:14.070054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd8234-8b48-435f-a952-4e3bf74490e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:14.070664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8234-8b48-435f-a952-4e3bf74490e6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:14.070938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8234-8b48-435f-a952-4e3bf74490e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:14.071205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8234-8b48-435f-a952-4e3bf74490e6 None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:14.072329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8234-8b48-435f-a952-4e3bf74490e6 None admin] RBAC: Authorizing `identity:get_project(project_id=75ac398df2294ab8b320f1c7d8839721)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:14.073754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8234-8b48-435f-a952-4e3bf74490e6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:14.075367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 547/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:13 2022] GET /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:14.081396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:14.169337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:14.178557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e110c44-a710-43c6-9bd8-2c2013f8bc02 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:14.209988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a3cee-b91c-4074-9d45-1b1230e93ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:14.210623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3cee-b91c-4074-9d45-1b1230e93ebe None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:14.210899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3cee-b91c-4074-9d45-1b1230e93ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:14.211170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3cee-b91c-4074-9d45-1b1230e93ebe None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721/users/f2c2059262b54d3597d4b1072b58971a/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:14.213334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a3cee-b91c-4074-9d45-1b1230e93ebe None admin] RBAC: Authorizing `identity:create_grant(project_id=75ac398df2294ab8b320f1c7d8839721, user_id=f2c2059262b54d3597d4b1072b58971a, role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:14.214743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a3cee-b91c-4074-9d45-1b1230e93ebe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:14.226949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 576/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:11:14 2022] PUT /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721/users/f2c2059262b54d3597d4b1072b58971a/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:11:16.087545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540344-e09a-4780-93e0-068f66a86da5 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:16.088031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540344-e09a-4780-93e0-068f66a86da5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:16.088139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540344-e09a-4780-93e0-068f66a86da5 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:16.089423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 548/1124] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:16.094614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86338a-2958-4ac3-b8f3-db90dc21a53a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:16.095047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86338a-2958-4ac3-b8f3-db90dc21a53a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:16.095147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86338a-2958-4ac3-b8f3-db90dc21a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:16.113265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6d86338a-2958-4ac3-b8f3-db90dc21a53a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:16.114431 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d86338a-2958-4ac3-b8f3-db90dc21a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:16.177973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 577/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:16.450403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540344-e09a-4780-93e0-068f66a86da5 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:16.540077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:16.551329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540344-e09a-4780-93e0-068f66a86da5 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:16.583244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:16.583874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:16.584151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:16.584417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] PATH_INFO: `/v3/roles/737d6089de4d4a44bc7a5da4266f3506` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:16.585782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] RBAC: Authorizing `identity:get_role(role_id=737d6089de4d4a44bc7a5da4266f3506)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:16.587133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:16.588450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 549/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:16 2022] GET /identity/v3/roles/737d6089de4d4a44bc7a5da4266f3506 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:16.594579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86338a-2958-4ac3-b8f3-db90dc21a53a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:16.673892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:16.690661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86338a-2958-4ac3-b8f3-db90dc21a53a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:16.723679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:16.724240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:16.724518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:16.724789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] PATH_INFO: `/v3/users/f2c2059262b54d3597d4b1072b58971a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:16.725889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] RBAC: Authorizing `identity:get_user(user_id=f2c2059262b54d3597d4b1072b58971a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:16.727305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:16.728866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 578/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:16 2022] GET /identity/v3/users/f2c2059262b54d3597d4b1072b58971a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:16.734414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:16.830920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5512c69-3cf2-409c-8e65-dcddb3de95a0 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:16.863107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:16.863721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:16.864007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:16.864277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:16.890135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:16.930077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:16.931539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:17.026974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 550/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:17.032850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:17.127355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b555a9-0ca7-4f99-aff0-915aa77f0fdb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:17.159313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa078ff-07e6-4d1e-ba5c-7e537e6aa8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:17.160083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa078ff-07e6-4d1e-ba5c-7e537e6aa8ef None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:17.160362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa078ff-07e6-4d1e-ba5c-7e537e6aa8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:17.160628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa078ff-07e6-4d1e-ba5c-7e537e6aa8ef None admin] PATH_INFO: `/v3/projects/75ac398df2294ab8b320f1c7d8839721` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:17.161708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa078ff-07e6-4d1e-ba5c-7e537e6aa8ef None admin] RBAC: Authorizing `identity:get_project(project_id=75ac398df2294ab8b320f1c7d8839721)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:17.163107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa078ff-07e6-4d1e-ba5c-7e537e6aa8ef None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:17.164710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 579/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:17 2022] GET /identity/v3/projects/75ac398df2294ab8b320f1c7d8839721 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:17.170538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:17.228124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:17.270100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb485a-ae28-40d6-bd47-454a43e2a378 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:17.302327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffec181-c0e8-4353-ab04-b4b8ba592337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:17.302911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffec181-c0e8-4353-ab04-b4b8ba592337 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:17.303184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffec181-c0e8-4353-ab04-b4b8ba592337 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:17.303478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffec181-c0e8-4353-ab04-b4b8ba592337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:17.304188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffec181-c0e8-4353-ab04-b4b8ba592337 None admin] RBAC: Adding query filter params (role.id=737d6089de4d4a44bc7a5da4266f3506, scope.project.id=75ac398df2294ab8b320f1c7d8839721, user.id=f2c2059262b54d3597d4b1072b58971a) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:17.304488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffec181-c0e8-4353-ab04-b4b8ba592337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:17.305903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffec181-c0e8-4353-ab04-b4b8ba592337 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:17.311504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 551/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:17 2022] GET /identity/v3/role_assignments?user.id=f2c2059262b54d3597d4b1072b58971a&scope.project.id=75ac398df2294ab8b320f1c7d8839721&role.id=737d6089de4d4a44bc7a5da4266f3506 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:19.196231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558fef-f256-4109-b165-2a0eccea0876 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:19.196746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558fef-f256-4109-b165-2a0eccea0876 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:19.196867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558fef-f256-4109-b165-2a0eccea0876 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:19.198105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 580/1131] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:19.203634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c359-60fc-430f-8cc7-59d4f288f00e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:19.204055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c359-60fc-430f-8cc7-59d4f288f00e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:19.204174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c359-60fc-430f-8cc7-59d4f288f00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:19.222465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-46c0c359-60fc-430f-8cc7-59d4f288f00e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:19.223680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-46c0c359-60fc-430f-8cc7-59d4f288f00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:19.287415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 552/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:19.560680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45558fef-f256-4109-b165-2a0eccea0876 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:19.580856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:19.664200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45558fef-f256-4109-b165-2a0eccea0876 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:19.697167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23982f49-b4d3-412a-9381-6112ccd25b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:19.697780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982f49-b4d3-412a-9381-6112ccd25b59 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:19.698057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982f49-b4d3-412a-9381-6112ccd25b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:19.698327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982f49-b4d3-412a-9381-6112ccd25b59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:19.699450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23982f49-b4d3-412a-9381-6112ccd25b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:19.700869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23982f49-b4d3-412a-9381-6112ccd25b59 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:19.702406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 581/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:19.708355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c359-60fc-430f-8cc7-59d4f288f00e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:19.758403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:19.802941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c359-60fc-430f-8cc7-59d4f288f00e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:19.835191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecb142-f5b7-455e-a0b3-1ee791a3b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:19.835752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb142-f5b7-455e-a0b3-1ee791a3b75f None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:19.836026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb142-f5b7-455e-a0b3-1ee791a3b75f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:19.836291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb142-f5b7-455e-a0b3-1ee791a3b75f None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:19.836929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecb142-f5b7-455e-a0b3-1ee791a3b75f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:19.838341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecb142-f5b7-455e-a0b3-1ee791a3b75f None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:19.864003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 553/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:11:19 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:11:21.758296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79465b28-d20f-440c-848d-9c983955fe48 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:21.758849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79465b28-d20f-440c-848d-9c983955fe48 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:21.758849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79465b28-d20f-440c-848d-9c983955fe48 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:21.760177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 582/1135] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:21.765224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce2a99-9fd1-4c03-90d9-2f1859f44df4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:21.765642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce2a99-9fd1-4c03-90d9-2f1859f44df4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:21.765776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce2a99-9fd1-4c03-90d9-2f1859f44df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:21.784113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8fce2a99-9fd1-4c03-90d9-2f1859f44df4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:21.785295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8fce2a99-9fd1-4c03-90d9-2f1859f44df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:21.849100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 554/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:22.118662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79465b28-d20f-440c-848d-9c983955fe48 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:22.201236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:22.217330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79465b28-d20f-440c-848d-9c983955fe48 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:22.250288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2e37-6fab-4cba-a63a-7c7d273583d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:22.250894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2e37-6fab-4cba-a63a-7c7d273583d1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:22.251168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2e37-6fab-4cba-a63a-7c7d273583d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:22.251462 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2e37-6fab-4cba-a63a-7c7d273583d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:22.252558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2e37-6fab-4cba-a63a-7c7d273583d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:22.253981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2e37-6fab-4cba-a63a-7c7d273583d1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:22.255536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 583/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:22.261389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce2a99-9fd1-4c03-90d9-2f1859f44df4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:22.293573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:22.360208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce2a99-9fd1-4c03-90d9-2f1859f44df4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:22.393511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756dd8a-6c53-4275-819a-109b83df6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:22.394040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756dd8a-6c53-4275-819a-109b83df6fed None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:22.394315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756dd8a-6c53-4275-819a-109b83df6fed None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:22.394585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756dd8a-6c53-4275-819a-109b83df6fed None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:22.395237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756dd8a-6c53-4275-819a-109b83df6fed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:22.396693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756dd8a-6c53-4275-819a-109b83df6fed None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:22.416373 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 555/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:11:22 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:11:24.332579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795badd-0893-4504-abc9-968276b337bb None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:24.333096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795badd-0893-4504-abc9-968276b337bb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:24.333096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795badd-0893-4504-abc9-968276b337bb None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:24.334362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 584/1139] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:24.339620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d815c6-9f26-4695-8edb-e9cdaff6d61c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:24.340007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d815c6-9f26-4695-8edb-e9cdaff6d61c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:24.340173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d815c6-9f26-4695-8edb-e9cdaff6d61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:24.358395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-65d815c6-9f26-4695-8edb-e9cdaff6d61c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:24.360133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-65d815c6-9f26-4695-8edb-e9cdaff6d61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:24.424143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 556/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:24.697670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795badd-0893-4504-abc9-968276b337bb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:24.795919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795badd-0893-4504-abc9-968276b337bb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:24.828302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:24.828905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:24.829181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:24.829449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:24.839125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:24.844422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:24.845697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:24.846816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 585/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:24.851322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d815c6-9f26-4695-8edb-e9cdaff6d61c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:24.873233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:24.952316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d815c6-9f26-4695-8edb-e9cdaff6d61c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:24.988552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:24.989153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:24.989431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:24.989699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:24.990351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:24.990651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:24.992060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:25.000603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 557/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:25.006340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:25.022926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:25.105057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f300824-7bcf-468a-b2ec-36a6c09c3856 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:25.138529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:25.139142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:25.139447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:25.139722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] PATH_INFO: `/v3/users/2666baacacf14d06a60960a616a042cc` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:25.152589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] RBAC: Authorizing `identity:get_user(user_id=2666baacacf14d06a60960a616a042cc)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:25.154029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:25.155673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 586/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:25 2022] GET /identity/v3/users/2666baacacf14d06a60960a616a042cc => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:25.161573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:25.245906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:25.264148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205f72-c3b7-44f6-b33d-86635172b21d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:25.297120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:25.297713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:25.297989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:25.298257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:25.363528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:25.364995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:25.441206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:25.459621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 558/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:25.465535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:25.533659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:25.562021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610f8de-4910-4672-9d8e-6430965c9d54 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:25.594372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e178a3c-b93c-451c-93ab-2befa36fbfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:25.594980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178a3c-b93c-451c-93ab-2befa36fbfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:25.595255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178a3c-b93c-451c-93ab-2befa36fbfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:25.595553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178a3c-b93c-451c-93ab-2befa36fbfa2 None admin] PATH_INFO: `/v3/projects/05bb0e757aa1455a9edc58f236fa280b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:25.596641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e178a3c-b93c-451c-93ab-2befa36fbfa2 None admin] RBAC: Authorizing `identity:get_project(project_id=05bb0e757aa1455a9edc58f236fa280b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:25.598052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e178a3c-b93c-451c-93ab-2befa36fbfa2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:25.599738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 587/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:25 2022] GET /identity/v3/projects/05bb0e757aa1455a9edc58f236fa280b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:25.605749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:25.700913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023ec5e-1037-466a-be46-efbb0f520164 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:25.733933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e9063-f2a9-4573-ae4f-f343f2603142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:25.734513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e9063-f2a9-4573-ae4f-f343f2603142 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:25.734791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e9063-f2a9-4573-ae4f-f343f2603142 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:25.735058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e9063-f2a9-4573-ae4f-f343f2603142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:25.735791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e9063-f2a9-4573-ae4f-f343f2603142 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=05bb0e757aa1455a9edc58f236fa280b, user.id=2666baacacf14d06a60960a616a042cc) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:25.736100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e9063-f2a9-4573-ae4f-f343f2603142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:25.737512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e9063-f2a9-4573-ae4f-f343f2603142 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:25.742652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 559/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:25 2022] GET /identity/v3/role_assignments?user.id=2666baacacf14d06a60960a616a042cc&scope.project.id=05bb0e757aa1455a9edc58f236fa280b&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:27.618534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ef91-2f4f-4f03-88e0-4bb081a544b3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:27.619071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ef91-2f4f-4f03-88e0-4bb081a544b3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:27.619160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ef91-2f4f-4f03-88e0-4bb081a544b3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:27.620542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 588/1147] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:27.625706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bb1c-340d-4c1d-ad8f-6a1cfa35645f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:27.626102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bb1c-340d-4c1d-ad8f-6a1cfa35645f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:27.626248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bb1c-340d-4c1d-ad8f-6a1cfa35645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:27.644196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3877bb1c-340d-4c1d-ad8f-6a1cfa35645f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:27.645383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3877bb1c-340d-4c1d-ad8f-6a1cfa35645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:27.686556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:27.710025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 560/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:27.984050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ef91-2f4f-4f03-88e0-4bb081a544b3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:28.082635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ef91-2f4f-4f03-88e0-4bb081a544b3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:28.115291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:28.115933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:28.116211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:28.116509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:28.123835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:28.126657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:28.131889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:28.133283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:28.134349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 589/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:28.139362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877bb1c-340d-4c1d-ad8f-6a1cfa35645f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:28.235660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877bb1c-340d-4c1d-ad8f-6a1cfa35645f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:28.269605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:28.270194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:28.270469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:28.270737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:28.271408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:28.271714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:28.273068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:28.280843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 561/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:28.286580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:28.383467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b671-5943-4833-a4c2-d2e5bb4cfa11 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:28.416388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:28.416993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:28.417271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:28.417547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] PATH_INFO: `/v3/users/2666baacacf14d06a60960a616a042cc` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:28.418643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] RBAC: Authorizing `identity:get_user(user_id=2666baacacf14d06a60960a616a042cc)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:28.420091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:28.421645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 590/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:28 2022] GET /identity/v3/users/2666baacacf14d06a60960a616a042cc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:28.427142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:28.465866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:28.523617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079bcae-d4be-4d49-b010-971a20e0ac85 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:28.555584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e7ddc-1c18-4c91-9388-26ca86b9c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:28.556191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e7ddc-1c18-4c91-9388-26ca86b9c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:28.556470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e7ddc-1c18-4c91-9388-26ca86b9c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:28.556737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e7ddc-1c18-4c91-9388-26ca86b9c7a2 None admin] PATH_INFO: `/v3/projects/05bb0e757aa1455a9edc58f236fa280b` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:28.557827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e7ddc-1c18-4c91-9388-26ca86b9c7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=05bb0e757aa1455a9edc58f236fa280b)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:28.559238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e7ddc-1c18-4c91-9388-26ca86b9c7a2 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:28.560873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 562/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:28 2022] GET /identity/v3/projects/05bb0e757aa1455a9edc58f236fa280b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:28.567266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:28.638534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:28.669945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d263f53-63cd-43f2-9cd9-bf0aac02bbba None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:28.702448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf642be-cab3-4240-b2a6-90ec40b56adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:28.703110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf642be-cab3-4240-b2a6-90ec40b56adc None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:28.703391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf642be-cab3-4240-b2a6-90ec40b56adc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:28.703676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf642be-cab3-4240-b2a6-90ec40b56adc None admin] PATH_INFO: `/v3/projects/05bb0e757aa1455a9edc58f236fa280b/users/2666baacacf14d06a60960a616a042cc/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:28.705521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf642be-cab3-4240-b2a6-90ec40b56adc None admin] RBAC: Authorizing `identity:create_grant(project_id=05bb0e757aa1455a9edc58f236fa280b, user_id=2666baacacf14d06a60960a616a042cc, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:28.706925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf642be-cab3-4240-b2a6-90ec40b56adc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:28.719172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 591/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:11:28 2022] PUT /identity/v3/projects/05bb0e757aa1455a9edc58f236fa280b/users/2666baacacf14d06a60960a616a042cc/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:11:30.573784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3775a-fee6-40cc-b142-601c7d45d17f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:30.574333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3775a-fee6-40cc-b142-601c7d45d17f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:30.574333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3775a-fee6-40cc-b142-601c7d45d17f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:30.575703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 563/1154] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:30.581501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2e19-1d3c-43c1-a506-a75804a13ab6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:30.581931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2e19-1d3c-43c1-a506-a75804a13ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:30.582043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2e19-1d3c-43c1-a506-a75804a13ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:30.600502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d17b2e19-1d3c-43c1-a506-a75804a13ab6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:30.601676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d17b2e19-1d3c-43c1-a506-a75804a13ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:30.665648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 592/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:11:30.932753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3775a-fee6-40cc-b142-601c7d45d17f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:31.033860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3775a-fee6-40cc-b142-601c7d45d17f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:31.040941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:31.066694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:31.067307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:31.067609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:31.067880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:31.078024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:31.082721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:31.083835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:11:31.084878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 564/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:31.089963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b2e19-1d3c-43c1-a506-a75804a13ab6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:31.145289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:31.185181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b2e19-1d3c-43c1-a506-a75804a13ab6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:31.217261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:31.217844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:31.220333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:31.220609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:31.221272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:31.221571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:31.222936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:31.230862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 593/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:31.236591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:31.343890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61642baa-1dbb-46e4-ab1e-f4958996c67b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:31.376143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:31.376748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:31.377022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:31.377287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] PATH_INFO: `/v3/users/2666baacacf14d06a60960a616a042cc` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:31.378376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] RBAC: Authorizing `identity:get_user(user_id=2666baacacf14d06a60960a616a042cc)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:31.379864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:31.381415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 565/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:31 2022] GET /identity/v3/users/2666baacacf14d06a60960a616a042cc => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:31.387767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:31.484030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8047-bb69-43b3-8809-b040e9e508fe None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:31.503320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:31.517881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:31.518476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:31.518754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:31.519023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:31.584016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:31.585457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:31.679486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 594/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:31.685283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:31.718429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:31.782397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5f4ff-f011-4865-b923-965d3828d854 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:31.815445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e48188-bace-4e2d-acac-bda7468ae141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:31.816047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48188-bace-4e2d-acac-bda7468ae141 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:31.816322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48188-bace-4e2d-acac-bda7468ae141 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:31.816590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48188-bace-4e2d-acac-bda7468ae141 None admin] PATH_INFO: `/v3/projects/05bb0e757aa1455a9edc58f236fa280b` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:31.817682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e48188-bace-4e2d-acac-bda7468ae141 None admin] RBAC: Authorizing `identity:get_project(project_id=05bb0e757aa1455a9edc58f236fa280b)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:31.819102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e48188-bace-4e2d-acac-bda7468ae141 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:31.820727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 566/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:31 2022] GET /identity/v3/projects/05bb0e757aa1455a9edc58f236fa280b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:31.826616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:31.846985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:31.922961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4de40b-17df-462a-89e4-a4614fef15af None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:31.956103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a19799-c7c9-4a3f-87c6-422672eeead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:31.956688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19799-c7c9-4a3f-87c6-422672eeead8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:31.956968 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19799-c7c9-4a3f-87c6-422672eeead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:31.957239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19799-c7c9-4a3f-87c6-422672eeead8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:31.957959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19799-c7c9-4a3f-87c6-422672eeead8 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=05bb0e757aa1455a9edc58f236fa280b, user.id=2666baacacf14d06a60960a616a042cc) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:31.958266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19799-c7c9-4a3f-87c6-422672eeead8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:31.959709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19799-c7c9-4a3f-87c6-422672eeead8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:31.965234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 595/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:31 2022] GET /identity/v3/role_assignments?user.id=2666baacacf14d06a60960a616a042cc&scope.project.id=05bb0e757aa1455a9edc58f236fa280b&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:33.862146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea502-49f2-463c-a006-77b5207a21b9 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:33.862748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea502-49f2-463c-a006-77b5207a21b9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:33.862748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea502-49f2-463c-a006-77b5207a21b9 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:33.864067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 567/1162] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:33.869131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a805-82af-433b-b7eb-4943eee23939 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:33.869550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a805-82af-433b-b7eb-4943eee23939 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:33.869683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a805-82af-433b-b7eb-4943eee23939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:33.888706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-abd3a805-82af-433b-b7eb-4943eee23939 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:33.890391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-abd3a805-82af-433b-b7eb-4943eee23939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:33.957896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 596/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:34.237747 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ea502-49f2-463c-a006-77b5207a21b9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:34.337610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ea502-49f2-463c-a006-77b5207a21b9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:34.339096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:34.371099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:34.371693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:34.371975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:34.372243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:34.437406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:34.438841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:34.532883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 568/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:34.538922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3a805-82af-433b-b7eb-4943eee23939 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:34.553379 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:34.635379 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3a805-82af-433b-b7eb-4943eee23939 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:34.667176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fbf82-b330-41dd-bb0d-3bf00744136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:34.667819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fbf82-b330-41dd-bb0d-3bf00744136c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:34.668097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fbf82-b330-41dd-bb0d-3bf00744136c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:34.668363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fbf82-b330-41dd-bb0d-3bf00744136c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:34.675238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fbf82-b330-41dd-bb0d-3bf00744136c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:34.676694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fbf82-b330-41dd-bb0d-3bf00744136c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6d2fbf82-b330-41dd-bb0d-3bf00744136c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:34.688350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:34.689554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:34.690585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 597/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:11:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:34.695263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:34.697489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:34.790354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9f3b-cc6c-4380-bac6-a89e06370782 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:34.824120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87b85-9c14-4764-9856-c0bcd917b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:34.824702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87b85-9c14-4764-9856-c0bcd917b212 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:34.824978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87b85-9c14-4764-9856-c0bcd917b212 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:34.825247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87b85-9c14-4764-9856-c0bcd917b212 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:34.825873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87b85-9c14-4764-9856-c0bcd917b212 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:34.826170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87b85-9c14-4764-9856-c0bcd917b212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:34.827568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87b85-9c14-4764-9856-c0bcd917b212 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:34.834390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 569/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Sep 6 04:11:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:36.714993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0ef2f-496d-4078-a5f9-49223c69af3c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:36.715562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0ef2f-496d-4078-a5f9-49223c69af3c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:36.715562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0ef2f-496d-4078-a5f9-49223c69af3c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:36.716877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 598/1167] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:36.722657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde0f2-2cf9-476a-b433-0d87a358cb15 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:36.723038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde0f2-2cf9-476a-b433-0d87a358cb15 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:36.723202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde0f2-2cf9-476a-b433-0d87a358cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:36.741485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-dfbde0f2-2cf9-476a-b433-0d87a358cb15 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:36.742692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-dfbde0f2-2cf9-476a-b433-0d87a358cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:36.799672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:36.807097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 570/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:37.072493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0ef2f-496d-4078-a5f9-49223c69af3c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:37.145997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:37.171175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0ef2f-496d-4078-a5f9-49223c69af3c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:37.203186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd056c9-c2e7-4c23-a706-a1d0e3384fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:37.203792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd056c9-c2e7-4c23-a706-a1d0e3384fec None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:37.204064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd056c9-c2e7-4c23-a706-a1d0e3384fec None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:37.204327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd056c9-c2e7-4c23-a706-a1d0e3384fec None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:37.204984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd056c9-c2e7-4c23-a706-a1d0e3384fec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:37.206323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd056c9-c2e7-4c23-a706-a1d0e3384fec None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:37.222119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 599/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Tue Sep 6 04:11:37 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:11:39.140789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421b24-cf5d-4e0c-b410-d81d31797f9e None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:39.141290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421b24-cf5d-4e0c-b410-d81d31797f9e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:39.141374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421b24-cf5d-4e0c-b410-d81d31797f9e None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:39.142690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 571/1170] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:39.147798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946218c-f55c-47be-a309-264411041970 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:39.148186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946218c-f55c-47be-a309-264411041970 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:39.148343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946218c-f55c-47be-a309-264411041970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:39.166532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f946218c-f55c-47be-a309-264411041970 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:39.167761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f946218c-f55c-47be-a309-264411041970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:39.231849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 600/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:39.501550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7421b24-cf5d-4e0c-b410-d81d31797f9e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:39.599053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7421b24-cf5d-4e0c-b410-d81d31797f9e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:39.631240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4fd3-f449-4ffa-b456-f3a46bccb848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:39.631868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4fd3-f449-4ffa-b456-f3a46bccb848 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:39.632389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4fd3-f449-4ffa-b456-f3a46bccb848 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:39.632666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4fd3-f449-4ffa-b456-f3a46bccb848 None admin] PATH_INFO: `/v3/domains/612c6eddac5a404f8023d8290f44085b` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:39.643032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4fd3-f449-4ffa-b456-f3a46bccb848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=612c6eddac5a404f8023d8290f44085b)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:39.644484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4fd3-f449-4ffa-b456-f3a46bccb848 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:39.646013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 572/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Sep 6 04:11:39 2022] GET /identity/v3/domains/612c6eddac5a404f8023d8290f44085b => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:39.651647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946218c-f55c-47be-a309-264411041970 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:39.710860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:39.747555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946218c-f55c-47be-a309-264411041970 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:39.781012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6344df-7cab-4e1b-a77d-92c5cc70cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:39.781584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6344df-7cab-4e1b-a77d-92c5cc70cb40 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:39.781864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6344df-7cab-4e1b-a77d-92c5cc70cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:39.782136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6344df-7cab-4e1b-a77d-92c5cc70cb40 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:39.782776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6344df-7cab-4e1b-a77d-92c5cc70cb40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:39.784223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6344df-7cab-4e1b-a77d-92c5cc70cb40 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:39.808823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 601/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:11:39 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:11:41.733177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837641-079e-4d96-a1ef-e916745f6329 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:41.733812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837641-079e-4d96-a1ef-e916745f6329 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:41.733812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837641-079e-4d96-a1ef-e916745f6329 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:41.735704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 573/1174] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:41.740729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff87f0-0e35-418a-9062-1befe72e4240 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:41.741157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff87f0-0e35-418a-9062-1befe72e4240 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:41.741277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff87f0-0e35-418a-9062-1befe72e4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:41.759253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-24ff87f0-0e35-418a-9062-1befe72e4240 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:41.760463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-24ff87f0-0e35-418a-9062-1befe72e4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:41.824332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 602/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:42.089336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20837641-079e-4d96-a1ef-e916745f6329 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:42.145816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:42.190006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20837641-079e-4d96-a1ef-e916745f6329 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:42.223143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504baf2-0005-464e-a426-40e0acfd1939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:42.223774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504baf2-0005-464e-a426-40e0acfd1939 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:42.224050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504baf2-0005-464e-a426-40e0acfd1939 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:42.224320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504baf2-0005-464e-a426-40e0acfd1939 None admin] PATH_INFO: `/v3/domains/612c6eddac5a404f8023d8290f44085b` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:42.225418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504baf2-0005-464e-a426-40e0acfd1939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=612c6eddac5a404f8023d8290f44085b)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:42.226854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504baf2-0005-464e-a426-40e0acfd1939 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:42.228411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 574/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Sep 6 04:11:42 2022] GET /identity/v3/domains/612c6eddac5a404f8023d8290f44085b => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:42.234027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff87f0-0e35-418a-9062-1befe72e4240 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:42.278853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:42.336218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff87f0-0e35-418a-9062-1befe72e4240 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:42.368352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590179e7-7c84-4e60-880f-bc50e2c3a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:42.368947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590179e7-7c84-4e60-880f-bc50e2c3a5b0 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:42.369221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590179e7-7c84-4e60-880f-bc50e2c3a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:42.369483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590179e7-7c84-4e60-880f-bc50e2c3a5b0 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:42.370115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590179e7-7c84-4e60-880f-bc50e2c3a5b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:42.371548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590179e7-7c84-4e60-880f-bc50e2c3a5b0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:42.393103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 603/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:11:42 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:11:44.315579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741486-3f87-4da6-828a-8c440a324779 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:44.316092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741486-3f87-4da6-828a-8c440a324779 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:44.316092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741486-3f87-4da6-828a-8c440a324779 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:44.317389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 575/1178] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:44.322501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844225a-a4f2-4291-b95e-fa8c208b35c4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:44.322920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844225a-a4f2-4291-b95e-fa8c208b35c4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:44.323045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844225a-a4f2-4291-b95e-fa8c208b35c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:44.341163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6844225a-a4f2-4291-b95e-fa8c208b35c4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:44.342325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6844225a-a4f2-4291-b95e-fa8c208b35c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:44.405530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 604/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:44.675423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741486-3f87-4da6-828a-8c440a324779 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:44.772510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741486-3f87-4da6-828a-8c440a324779 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:44.794317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:44.804768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:44.805369 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:44.805640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:44.805907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:44.816065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:44.820756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:44.821938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:11:44.823038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 576/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:44.827812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844225a-a4f2-4291-b95e-fa8c208b35c4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:44.857443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:44.926900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844225a-a4f2-4291-b95e-fa8c208b35c4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:44.959602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:44.960191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:44.960469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:44.960732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:44.961381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:44.961676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:44.963013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:44.970792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 605/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:44.976511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:45.071499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802ea4-c5d0-47ec-9fc9-b5763172e97f None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:45.104920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:45.105530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:45.105803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:45.106069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] PATH_INFO: `/v3/users/d26ecb9878e74d6dbdba2f4d1ea43b33` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:45.119184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] RBAC: Authorizing `identity:get_user(user_id=d26ecb9878e74d6dbdba2f4d1ea43b33)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:45.120710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:45.122275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 577/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:44 2022] GET /identity/v3/users/d26ecb9878e74d6dbdba2f4d1ea43b33 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:45.128817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:45.219829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:45.226683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740495-89d2-43b8-8ce5-528b6a392975 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:45.258748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:45.259333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:45.259649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:45.259918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:45.324656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:45.326090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:45.413734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:45.421275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 606/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:45.427087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:45.470710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:45.524885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd7b1-c194-46b7-b7aa-ad0115126589 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:45.557057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d101f-2527-42ae-b711-cac19e1f2631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:45.557668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d101f-2527-42ae-b711-cac19e1f2631 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:45.557940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d101f-2527-42ae-b711-cac19e1f2631 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:45.558204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d101f-2527-42ae-b711-cac19e1f2631 None admin] PATH_INFO: `/v3/projects/70c2226b475c48869d091500e9018b85` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:45.559284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d101f-2527-42ae-b711-cac19e1f2631 None admin] RBAC: Authorizing `identity:get_project(project_id=70c2226b475c48869d091500e9018b85)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:45.560724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d101f-2527-42ae-b711-cac19e1f2631 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:45.562319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 578/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:45 2022] GET /identity/v3/projects/70c2226b475c48869d091500e9018b85 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:45.569181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:45.664876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b3ce-b8bd-4d2b-b8d9-169bf8750061 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:45.697528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f573df-d507-468c-88b6-827895e19c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:45.698113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f573df-d507-468c-88b6-827895e19c22 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:45.698389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f573df-d507-468c-88b6-827895e19c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:45.698658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f573df-d507-468c-88b6-827895e19c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:45.699393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f573df-d507-468c-88b6-827895e19c22 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=70c2226b475c48869d091500e9018b85, user.id=d26ecb9878e74d6dbdba2f4d1ea43b33) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:45.699704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f573df-d507-468c-88b6-827895e19c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:45.701119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f573df-d507-468c-88b6-827895e19c22 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:45.706809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 607/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:45 2022] GET /identity/v3/role_assignments?user.id=d26ecb9878e74d6dbdba2f4d1ea43b33&scope.project.id=70c2226b475c48869d091500e9018b85&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:47.548662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f2712-68bf-4da9-81ce-b48068bfa13d None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:47.549218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f2712-68bf-4da9-81ce-b48068bfa13d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:47.549218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f2712-68bf-4da9-81ce-b48068bfa13d None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:47.550529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 579/1186] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:47.555720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f65169-3892-4410-abe2-27fa5d35071c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:47.556132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f65169-3892-4410-abe2-27fa5d35071c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:47.556263 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f65169-3892-4410-abe2-27fa5d35071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:47.573962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c9f65169-3892-4410-abe2-27fa5d35071c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:47.575140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c9f65169-3892-4410-abe2-27fa5d35071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:47.626068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:47.639577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 608/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:47.905898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f2712-68bf-4da9-81ce-b48068bfa13d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:48.009077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f2712-68bf-4da9-81ce-b48068bfa13d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:48.020058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:48.043311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:48.043960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:48.044238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:48.044508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:48.054314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:48.059063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:48.060190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:11:48.061175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 580/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:48.066204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f65169-3892-4410-abe2-27fa5d35071c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:48.161885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f65169-3892-4410-abe2-27fa5d35071c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:48.193815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:48.194403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:48.194677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:48.194942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:48.195616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:48.195992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:48.197342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:48.205468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 609/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:48.210957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:48.308612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b858-1662-4ccc-89c5-6f4dc1b875de None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:48.341601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:48.342207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:48.342485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:48.342752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] PATH_INFO: `/v3/users/d26ecb9878e74d6dbdba2f4d1ea43b33` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:48.343882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d26ecb9878e74d6dbdba2f4d1ea43b33)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:48.345864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:48.347629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 581/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:48 2022] GET /identity/v3/users/d26ecb9878e74d6dbdba2f4d1ea43b33 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:48.353156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:48.401629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:48.450615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9d943-2ee5-4d12-93f0-e692473b4800 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:48.483356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14964e6-d34b-4a6d-a0f3-b2478ae89cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:48.483995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14964e6-d34b-4a6d-a0f3-b2478ae89cfe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:48.484274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14964e6-d34b-4a6d-a0f3-b2478ae89cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:48.484545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14964e6-d34b-4a6d-a0f3-b2478ae89cfe None admin] PATH_INFO: `/v3/projects/70c2226b475c48869d091500e9018b85` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:48.485678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14964e6-d34b-4a6d-a0f3-b2478ae89cfe None admin] RBAC: Authorizing `identity:get_project(project_id=70c2226b475c48869d091500e9018b85)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:48.487169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14964e6-d34b-4a6d-a0f3-b2478ae89cfe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:48.488841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 610/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:48 2022] GET /identity/v3/projects/70c2226b475c48869d091500e9018b85 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:48.494629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:48.534245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:48.592151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2852-809b-42d4-b986-ec0eaba333d8 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:48.624430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0473de5-052b-4598-82d6-8171054d495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:48.625062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0473de5-052b-4598-82d6-8171054d495a None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:48.625340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0473de5-052b-4598-82d6-8171054d495a None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:48.625610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0473de5-052b-4598-82d6-8171054d495a None admin] PATH_INFO: `/v3/projects/70c2226b475c48869d091500e9018b85/users/d26ecb9878e74d6dbdba2f4d1ea43b33/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:48.628026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0473de5-052b-4598-82d6-8171054d495a None admin] RBAC: Authorizing `identity:create_grant(project_id=70c2226b475c48869d091500e9018b85, user_id=d26ecb9878e74d6dbdba2f4d1ea43b33, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:48.629439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0473de5-052b-4598-82d6-8171054d495a None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:48.641524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 582/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:11:48 2022] PUT /identity/v3/projects/70c2226b475c48869d091500e9018b85/users/d26ecb9878e74d6dbdba2f4d1ea43b33/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:11:50.510786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957683-06cc-4b67-b79e-ff20e817a977 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:50.511323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957683-06cc-4b67-b79e-ff20e817a977 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:50.511323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957683-06cc-4b67-b79e-ff20e817a977 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:50.512689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 611/1193] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:11:50.517874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede194e-58c5-453b-b7ee-c8b3379b05b9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:50.518306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede194e-58c5-453b-b7ee-c8b3379b05b9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:50.518398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede194e-58c5-453b-b7ee-c8b3379b05b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:50.536366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-fede194e-58c5-453b-b7ee-c8b3379b05b9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:11:50.537552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fede194e-58c5-453b-b7ee-c8b3379b05b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:11:50.601838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 583/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:11:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:11:50.877721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38957683-06cc-4b67-b79e-ff20e817a977 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:50.976731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38957683-06cc-4b67-b79e-ff20e817a977 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:50.994311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:51.011911 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:51.012531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:51.012802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:51.013069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:51.023231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:11:51.028061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:11:51.029147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:11:51.030128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 612/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:11:51.035666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede194e-58c5-453b-b7ee-c8b3379b05b9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:51.061801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:51.134748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede194e-58c5-453b-b7ee-c8b3379b05b9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:51.168082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:51.168676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:51.168954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:51.169224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:51.169873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:51.170171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:51.171562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:51.179324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 584/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:51.185115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:51.283115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf7fa-ec41-4920-85df-ca049d6c30a0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:51.315618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:51.316225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:51.316498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:51.316764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] PATH_INFO: `/v3/users/d26ecb9878e74d6dbdba2f4d1ea43b33` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:51.317848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] RBAC: Authorizing `identity:get_user(user_id=d26ecb9878e74d6dbdba2f4d1ea43b33)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:51.319254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:51.320825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 613/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Sep 6 04:11:51 2022] GET /identity/v3/users/d26ecb9878e74d6dbdba2f4d1ea43b33 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:51.326666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:51.413850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:51.423437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137681b-9487-4086-b226-ac9ee5f466ea None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:51.456176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:51.456765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:51.457041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:51.457307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:51.522343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:51.523819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:51.607959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:51.618206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 585/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:11:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:11:51.624082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:51.669836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:11:51.721132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab33f58-5fbc-47aa-910b-4e8f65b7d610 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:51.753083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e1d47-b467-4332-83f2-773efd347acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:51.753686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e1d47-b467-4332-83f2-773efd347acb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:51.753963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e1d47-b467-4332-83f2-773efd347acb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:51.754232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e1d47-b467-4332-83f2-773efd347acb None admin] PATH_INFO: `/v3/projects/70c2226b475c48869d091500e9018b85` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:51.755319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e1d47-b467-4332-83f2-773efd347acb None admin] RBAC: Authorizing `identity:get_project(project_id=70c2226b475c48869d091500e9018b85)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:51.756754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e1d47-b467-4332-83f2-773efd347acb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:51.758588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 614/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Sep 6 04:11:51 2022] GET /identity/v3/projects/70c2226b475c48869d091500e9018b85 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:11:51.764830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:11:51.859186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b0c95-dfc7-4849-b7ff-6fe5bcae42de None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:11:51.892401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8b1d0-9616-4ca4-9719-5f9ececc38bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:11:51.892980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b1d0-9616-4ca4-9719-5f9ececc38bf None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:11:51.893256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b1d0-9616-4ca4-9719-5f9ececc38bf None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:11:51.893521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b1d0-9616-4ca4-9719-5f9ececc38bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:11:51.894226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8b1d0-9616-4ca4-9719-5f9ececc38bf None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=70c2226b475c48869d091500e9018b85, user.id=d26ecb9878e74d6dbdba2f4d1ea43b33) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:11:51.894526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8b1d0-9616-4ca4-9719-5f9ececc38bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:11:51.895965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8b1d0-9616-4ca4-9719-5f9ececc38bf None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:11:51.901504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 586/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:11:51 2022] GET /identity/v3/role_assignments?user.id=d26ecb9878e74d6dbdba2f4d1ea43b33&scope.project.id=70c2226b475c48869d091500e9018b85&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:01.748551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=43 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:01.898951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=73 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:46.856760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e15339-df57-486b-942a-4594b334ed0e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:46.857369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e15339-df57-486b-942a-4594b334ed0e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:46.857369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e15339-df57-486b-942a-4594b334ed0e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:46.858972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 615/1201] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:12:46.864508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfcc92-38b5-48ff-ada7-8a0325d93b20 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:46.865098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfcc92-38b5-48ff-ada7-8a0325d93b20 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:46.865098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfcc92-38b5-48ff-ada7-8a0325d93b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:46.886334 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b9bfcc92-38b5-48ff-ada7-8a0325d93b20 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:12:46.887657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b9bfcc92-38b5-48ff-ada7-8a0325d93b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:12:46.977525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 587/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:12:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:12:47.248130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e15339-df57-486b-942a-4594b334ed0e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:47.370727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e15339-df57-486b-942a-4594b334ed0e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:47.418983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:47.419698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:47.420064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:47.420312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:47.433097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:47.434815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:12:47.451658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:47.452792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:12:47.453792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:12:47.453792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:47.453792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:12:47.459693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 616/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:47.460690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfcc92-38b5-48ff-ada7-8a0325d93b20 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:47.595559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfcc92-38b5-48ff-ada7-8a0325d93b20 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:47.630051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:47.636516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a3a2d-651d-440a-8515-a91f58027649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:47.637166 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3a2d-651d-440a-8515-a91f58027649 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:47.637445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3a2d-651d-440a-8515-a91f58027649 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:47.637719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3a2d-651d-440a-8515-a91f58027649 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:47.638449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a3a2d-651d-440a-8515-a91f58027649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:47.639040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a3a2d-651d-440a-8515-a91f58027649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:47.641253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a3a2d-651d-440a-8515-a91f58027649 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:47.659864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 588/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:47.667261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:47.731347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:47.790897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230f0d-157f-4649-b8c8-e95f1a1a38c5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:47.832921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e0ae3-9986-47de-9ed3-f4498b28946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:47.833974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e0ae3-9986-47de-9ed3-f4498b28946e None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:47.834257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e0ae3-9986-47de-9ed3-f4498b28946e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:47.834537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e0ae3-9986-47de-9ed3-f4498b28946e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:47.835200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e0ae3-9986-47de-9ed3-f4498b28946e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:47.840271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e0ae3-9986-47de-9ed3-f4498b28946e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:47.865785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 617/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Sep 6 04:12:47 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:12:49.909624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0b1b8-f9fc-4fe8-b130-1db104448f19 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:49.910228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0b1b8-f9fc-4fe8-b130-1db104448f19 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:49.910228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0b1b8-f9fc-4fe8-b130-1db104448f19 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:49.911811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 589/1206] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:12:49.917006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d0c8-6ea5-4f24-a88e-b75d109e094a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:49.917469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d0c8-6ea5-4f24-a88e-b75d109e094a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:49.917560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d0c8-6ea5-4f24-a88e-b75d109e094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:49.938166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8341d0c8-6ea5-4f24-a88e-b75d109e094a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:12:49.939839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8341d0c8-6ea5-4f24-a88e-b75d109e094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:12:50.027399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 618/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:12:50.370097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0b1b8-f9fc-4fe8-b130-1db104448f19 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:50.507019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0b1b8-f9fc-4fe8-b130-1db104448f19 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:50.554758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:50.555443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:50.556653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:50.556653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:50.568454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:12:50.573606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:50.580047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:50.580958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 590/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:12:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:50.581760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d0c8-6ea5-4f24-a88e-b75d109e094a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:50.629192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:50.701803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d0c8-6ea5-4f24-a88e-b75d109e094a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:50.740381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:50.741002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:50.741280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:50.741546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:50.742198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:50.742500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:50.743894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:50.752368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 619/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:12:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:50.758018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:50.815001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:50.874349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9457e2-5346-4392-87c2-7f049639d934 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:50.920075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:50.920742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:50.920985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:50.921777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:50.934735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:50.936248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:12:50.951812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:50.952891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:12:50.953823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:12:50.953823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:50.953823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:50.953823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 591/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:50.960351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:51.077944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:51.081159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e2131-0072-4e00-ae05-b38a60a8906f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:51.119602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:51.120225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:51.120508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:51.120811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:51.121436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:51.121727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:51.123095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:51.136526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 620/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:51.142241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:51.256208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd91ac-eb63-45d7-bb6d-7f38d065c0e4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:51.258047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:51.296964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:51.297591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:51.297862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:51.298127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:51.305602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:51.307046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:12:51.320002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:51.321648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:51.322636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 592/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:51.327238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:51.442429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7725-0923-4463-b65c-2344f7cab496 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:51.481695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:51.482305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:51.482588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:51.482860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:51.483665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:51.484576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:51.486182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:51.510178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 621/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Sep 6 04:12:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:51.510969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:51.631600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51458d0-2779-4b61-a712-2c6dec4783d4 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:51.670880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:51.672074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:51.672351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:51.672620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:51.704127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:51.746219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:51.747721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:51.859478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 593/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:12:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:12:51.862805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:51.887178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:51.974711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc6e0a-5386-476d-8407-577235b1058b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:52.020100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:52.020739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:52.021020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:52.021294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:52.033107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:52.034836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:12:52.050892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:52.053476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:12:52.054541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:12:52.054541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:52.054541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:12:52.054541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 622/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:12:52.061011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:52.141558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:52.186469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409b5e-8018-4871-9a95-c776bcb05dd5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:52.223200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:52.224223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:52.224431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:52.224617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:52.225261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:52.225649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:52.227340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:52.241679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 594/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:52.251417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:52.333988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:52.385404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e362-8c6b-423d-a4a3-be0a8d3d3614 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:52.427824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:52.428367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:52.428646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:52.428917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:52.436922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:52.438645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:12:52.451632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:52.452693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:12:52.453794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 623/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:52.458558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:52.573852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259104c1-7ccc-483e-8e1a-4b0d71831b8b None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:52.605223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:52.617805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c9ab-c100-4c42-b303-5398743365c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:52.618448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c9ab-c100-4c42-b303-5398743365c4 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:52.618719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c9ab-c100-4c42-b303-5398743365c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:52.619007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c9ab-c100-4c42-b303-5398743365c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:52.619757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c9ab-c100-4c42-b303-5398743365c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:52.620067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c9ab-c100-4c42-b303-5398743365c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:52.621586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c9ab-c100-4c42-b303-5398743365c4 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:52.634134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 595/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:12:52.640461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:52.756376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63c426-6264-44dd-acf6-a4f83a8faf41 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:52.796838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:52.804856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c9adc-c6d7-4972-b801-fe8991de0bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:52.805554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c9adc-c6d7-4972-b801-fe8991de0bbe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:52.805834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c9adc-c6d7-4972-b801-fe8991de0bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:52.806106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c9adc-c6d7-4972-b801-fe8991de0bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:52.806833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c9adc-c6d7-4972-b801-fe8991de0bbe None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=bbd74e1c4445439fa55b53f56f2befce) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:52.807142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c9adc-c6d7-4972-b801-fe8991de0bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:52.808621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c9adc-c6d7-4972-b801-fe8991de0bbe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:52.814641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 624/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:12:52 2022] GET /identity/v3/role_assignments?user.id=bbd74e1c4445439fa55b53f56f2befce&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:54.894850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df437075-6ddd-4619-a287-f96b250dd2a3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:54.895502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df437075-6ddd-4619-a287-f96b250dd2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:54.895502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df437075-6ddd-4619-a287-f96b250dd2a3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:54.897030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 596/1220] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:12:54.903073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e100b-7a93-40f0-9439-399187172400 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:54.903541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e100b-7a93-40f0-9439-399187172400 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:54.903766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e100b-7a93-40f0-9439-399187172400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:54.926442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-981e100b-7a93-40f0-9439-399187172400 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:12:54.928331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-981e100b-7a93-40f0-9439-399187172400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:12:55.003304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 625/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:12:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:12:55.303826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df437075-6ddd-4619-a287-f96b250dd2a3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:55.428238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df437075-6ddd-4619-a287-f96b250dd2a3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:55.464100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:55.464726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:55.465002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:55.465272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:55.475715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:12:55.480780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:55.481939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:55.482805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 597/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:55.489059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e100b-7a93-40f0-9439-399187172400 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:55.596901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e100b-7a93-40f0-9439-399187172400 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:55.622359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:55.635880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:55.636553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:55.636870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:55.637216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:55.637966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:55.638301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:55.639794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:55.648865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 626/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:55.655254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:55.715964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:55.786784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cae00-5587-48bb-b282-95dee5d8df70 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:55.826966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:55.827900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:55.828374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:55.828835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:55.841151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:55.842738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:12:55.858258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:55.859968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:12:55.860898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:12:55.860898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:55.860898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:55.860898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 598/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:55.866058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:55.975522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67570756-42fa-4148-9ccc-fe96b9c4bf42 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:56.019393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:56.020044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:56.020295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:56.020567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:56.021212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:56.021516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:56.022888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:56.035318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 627/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:12:56.041086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:56.146355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:56.153300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847d233-2625-46b6-a5af-8a2c8e77fabb None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:56.188624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:56.189247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:56.189555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:56.189793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:56.197244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:56.198703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:12:56.212489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:56.213722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:12:56.214948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:56.215642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 599/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:56.222786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:56.276688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:56.337698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da06ad5-1ce2-4e1e-bc84-66629606a332 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:56.379055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:56.379685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:56.379955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:56.380323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:56.381407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:56.381872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:56.383445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:56.402121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 628/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Sep 6 04:12:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:56.409773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:56.518572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75071-cfc0-42a8-ba65-8a535a27c841 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:56.554866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:56.555639 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:56.555881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:56.556090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:56.567290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:56.568777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:12:56.585624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:56.586819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:12:56.588122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:12:56.588122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:12:56.588122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:56.588122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 600/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:12:56.594200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:56.707865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c480-3795-4629-983a-f3cf1deb7f2a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:56.710400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:56.744784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:56.745391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:56.745734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:56.746075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:56.746875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:56.747184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:56.748699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:56.761593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 629/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:56.768851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:56.780940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:56.899741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff555f8-f23a-4f0e-a2f1-e90a2525f581 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:56.944253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:56.944871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:56.945216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:56.945525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:56.953490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:56.954924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:12:56.967185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:56.968308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:12:56.969417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 601/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:56.974938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:57.081098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb5fac-1d4c-4fce-880d-daa6aead180c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:57.121323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2462-fb83-4b16-b317-3d54006973e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:57.122199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2462-fb83-4b16-b317-3d54006973e6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:57.122482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2462-fb83-4b16-b317-3d54006973e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:57.122750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2462-fb83-4b16-b317-3d54006973e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:57.123524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2462-fb83-4b16-b317-3d54006973e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:57.123826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2462-fb83-4b16-b317-3d54006973e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:57.126115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2462-fb83-4b16-b317-3d54006973e6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:57.140232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 630/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:57.146898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:57.217561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:57.255385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7eba4-36c8-464b-ad70-9561bd0fe648 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:57.289583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0399a-33b5-4919-9b4a-d491e66ed9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:57.290221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0399a-33b5-4919-9b4a-d491e66ed9df None admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:57.290499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0399a-33b5-4919-9b4a-d491e66ed9df None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:57.290770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0399a-33b5-4919-9b4a-d491e66ed9df None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/bbd74e1c4445439fa55b53f56f2befce/roles/d43a5dcacbf942afad5a4c0cbfb314a2` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:57.305865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0399a-33b5-4919-9b4a-d491e66ed9df None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=bbd74e1c4445439fa55b53f56f2befce, role_id=d43a5dcacbf942afad5a4c0cbfb314a2)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:57.307300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0399a-33b5-4919-9b4a-d491e66ed9df None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:57.322115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 602/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:12:57 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/bbd74e1c4445439fa55b53f56f2befce/roles/d43a5dcacbf942afad5a4c0cbfb314a2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:12:59.232172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527b20-5285-44fd-8bfc-7c6037311384 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:59.232724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527b20-5285-44fd-8bfc-7c6037311384 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:59.232724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527b20-5285-44fd-8bfc-7c6037311384 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:59.234617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 631/1233] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:12:59.239981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a971-752e-42b8-941d-f23504b21b34 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:59.240416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a971-752e-42b8-941d-f23504b21b34 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:59.240527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a971-752e-42b8-941d-f23504b21b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:59.259962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-4de8a971-752e-42b8-941d-f23504b21b34 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:12:59.261112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4de8a971-752e-42b8-941d-f23504b21b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:12:59.337448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 603/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:12:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 04:12:59.615264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91527b20-5285-44fd-8bfc-7c6037311384 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:59.642472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:59.736409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91527b20-5285-44fd-8bfc-7c6037311384 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:59.775951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:59.776675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:59.777098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:59.777485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:59.790874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:12:59.796318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:12:59.797374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:12:59.798242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 632/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Sep 6 04:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:12:59.803635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8a971-752e-42b8-941d-f23504b21b34 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:12:59.853653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:12:59.910578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8a971-752e-42b8-941d-f23504b21b34 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:12:59.946255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:12:59.946848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:12:59.947123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:12:59.947407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:12:59.948092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] RBAC: Adding query filter params (name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:12:59.948360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:12:59.949781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:12:59.958283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 604/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Sep 6 04:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:12:59.963984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:00.060882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:00.079322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c94c-aa4b-4bdb-8e35-39e36efeb08c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:00.117886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:00.118512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:00.118807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:00.119053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:00.130298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:00.132067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:00.149012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:00.150217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:00.151114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:00.151114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:00.151114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:00.151114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 633/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:00.157242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:00.269902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5da9f-7655-4479-bf91-ce9f40871358 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:00.280994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:00.307802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:00.308402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:00.308700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:00.308967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:00.309589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:00.309883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:00.311263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:00.324814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 605/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:00.331898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:00.449428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc497e3-e531-46f3-ba61-2a0a676f49c0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:00.487736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:00.488420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:00.488688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:00.488980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:00.491993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:00.497610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:00.499889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:13:00.512543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:00.513597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:00.515165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 634/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:00.520577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:00.630026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25961764-7746-49d5-b36f-1e30ee4dd9bd None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:00.667250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:00.668032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:00.668304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:00.668568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:00.669303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:00.669656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:00.671218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:00.690854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 606/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Sep 6 04:13:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:00.696726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:00.809987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731b915-6788-4ece-8c77-a9d444b69bdd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:00.848843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:00.849442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:00.849714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:00.849977 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:00.916132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:00.924663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:00.926107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:01.040098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 635/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:13:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:13:01.046684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:01.076422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:01.159963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11f4b-89b3-4b20-a653-276580ba9faf None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:01.198314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:01.198979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:01.199342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:01.199683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:01.210466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:01.212179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:01.228877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:01.229932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:01.230840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:01.230840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:01.230840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:01.230840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 607/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:13:01.237150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:01.348428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:01.356107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48defef-3f8b-4b24-b62a-fa22539c42a5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:01.402427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:01.403035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:01.403323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:01.403594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:01.404232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:01.404599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:01.407220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:01.421817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 636/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:01.428664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:01.525962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:01.549269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160a8e4-b88e-46ff-a1d5-7c9dcca15c45 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:01.586184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:01.586877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:01.587142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:01.587443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:01.595473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:01.596960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:13:01.608206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:01.609341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:01.610421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 608/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:01.615543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:01.728788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40ef1-aa8a-476e-8b1c-7c3346b527a2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:01.768210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cce2f-d2f7-4c5a-a752-68f54bd1e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:01.768833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cce2f-d2f7-4c5a-a752-68f54bd1e0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:01.769128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cce2f-d2f7-4c5a-a752-68f54bd1e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:01.769396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cce2f-d2f7-4c5a-a752-68f54bd1e0c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:01.770088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cce2f-d2f7-4c5a-a752-68f54bd1e0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:01.770394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cce2f-d2f7-4c5a-a752-68f54bd1e0c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:01.771895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cce2f-d2f7-4c5a-a752-68f54bd1e0c8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:01.784986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 637/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:01.791205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:01.898028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bc9ba-8ff5-43d9-97bc-7ed3b3f7d6cd None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:01.933623 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54edc9b-fc85-4bb7-8be6-ac702c0a73ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:01.934225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54edc9b-fc85-4bb7-8be6-ac702c0a73ca None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:01.934594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54edc9b-fc85-4bb7-8be6-ac702c0a73ca None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:01.934844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54edc9b-fc85-4bb7-8be6-ac702c0a73ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:01.935724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54edc9b-fc85-4bb7-8be6-ac702c0a73ca None admin] RBAC: Adding query filter params (role.id=d43a5dcacbf942afad5a4c0cbfb314a2, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=bbd74e1c4445439fa55b53f56f2befce) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:01.936653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54edc9b-fc85-4bb7-8be6-ac702c0a73ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:01.938092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54edc9b-fc85-4bb7-8be6-ac702c0a73ca None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:01.945436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 609/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:13:01 2022] GET /identity/v3/role_assignments?user.id=bbd74e1c4445439fa55b53f56f2befce&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=d43a5dcacbf942afad5a4c0cbfb314a2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:04.134502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2b18-1b35-4b1c-8fca-42aee1473303 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:04.135182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2b18-1b35-4b1c-8fca-42aee1473303 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:04.135182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2b18-1b35-4b1c-8fca-42aee1473303 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:04.136628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 638/1247] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:13:04.142098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0553d-96dc-4363-bdc8-b059b7968839 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:04.142527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0553d-96dc-4363-bdc8-b059b7968839 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:04.142632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0553d-96dc-4363-bdc8-b059b7968839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:04.149272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:04.162779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-40e0553d-96dc-4363-bdc8-b059b7968839 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:13:04.164078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-40e0553d-96dc-4363-bdc8-b059b7968839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:13:04.237864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 610/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:13:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:13:04.539008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2b18-1b35-4b1c-8fca-42aee1473303 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:04.559588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:04.652604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2b18-1b35-4b1c-8fca-42aee1473303 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:04.689649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:04.690280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:04.690560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:04.690829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:04.701956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:13:04.707549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:04.708747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:04.709895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 639/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:04.715328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0553d-96dc-4363-bdc8-b059b7968839 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:04.826425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0553d-96dc-4363-bdc8-b059b7968839 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:04.860642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:04.867397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:04.868031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:04.868308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:04.868646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:04.869442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:04.869786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:04.871157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:04.881151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 611/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:04.887422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:04.976237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:05.006690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e02ab2-de12-4349-81ff-8d30ddb7e391 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:05.043866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:05.044494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:05.044849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:05.045145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:05.056505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:05.058103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:05.077497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:05.078601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:05.079761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:05.079761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:05.079761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:05.080373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 640/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 04:13:05.086488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:05.199355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4892-efee-43ca-ba10-0cb1ab2e720c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:05.235729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:05.236307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:05.236588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:05.236850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:05.237525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:05.237823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:05.239273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:05.252558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 612/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:05.258746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:05.376249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9c2e-8d3a-40c9-a69c-f756e528436d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:05.407690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:05.416422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:05.417025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:05.417339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:05.417673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:05.429510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:05.430963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:13:05.443067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:05.444811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:05.446247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 641/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:05.450242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:05.510182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:05.563150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406cda6-a774-4ce8-894b-59f032545957 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:05.600377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:05.600982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:05.601262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:05.601535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:05.602296 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:05.602597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:05.604118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:05.624273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 613/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Sep 6 04:13:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:05.630975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:05.741836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7af8-e417-4a58-ba47-d375fa19aca1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:05.779276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:05.780425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:05.780700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:05.780967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:05.839212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:05.854142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:05.855682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:05.959269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 642/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:13:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 04:13:05.965420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:06.077983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442724-ec16-47a7-bcbc-68b7d8023b5e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:06.093238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:06.118079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:06.118731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:06.119009 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:06.119279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:06.130866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:06.132393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:06.148689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:06.149890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:06.150996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:06.150996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:06.150996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:06.150996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 614/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:06.156496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:06.246490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:06.259324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a92b-fce8-40aa-8acc-e7d6a0a42580 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:06.295839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:06.296460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:06.296726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:06.296988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:06.297624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:06.297919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:06.299272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:06.311048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 643/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:06.317026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:06.439794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed404d62-0db6-49e8-97ab-49b51f579b9d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:06.476960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:06.477602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:06.477876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:06.478235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:06.486459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:06.494532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:13:06.506728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:06.507889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:06.508975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 615/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:06.516256 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:06.616959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7da6ba-b215-4783-827b-c74966f20e81 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:06.651497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ecaf9-b61d-4061-80f7-f3c6ae0c7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:06.652100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ecaf9-b61d-4061-80f7-f3c6ae0c7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:06.652379 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ecaf9-b61d-4061-80f7-f3c6ae0c7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:06.652652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ecaf9-b61d-4061-80f7-f3c6ae0c7bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:06.653339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ecaf9-b61d-4061-80f7-f3c6ae0c7bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:06.653644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ecaf9-b61d-4061-80f7-f3c6ae0c7bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:06.655103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ecaf9-b61d-4061-80f7-f3c6ae0c7bc5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:06.671447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 644/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:06.673565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:06.702309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:06.777857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7560ff6-2e3b-4916-9e4c-1335276bbb48 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:06.810357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456017f-8092-4ed6-8aa3-b3a005d20b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:06.811537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456017f-8092-4ed6-8aa3-b3a005d20b66 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:06.811818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456017f-8092-4ed6-8aa3-b3a005d20b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:06.812085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456017f-8092-4ed6-8aa3-b3a005d20b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:06.812801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456017f-8092-4ed6-8aa3-b3a005d20b66 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=bbd74e1c4445439fa55b53f56f2befce) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:06.813103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456017f-8092-4ed6-8aa3-b3a005d20b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:06.814526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456017f-8092-4ed6-8aa3-b3a005d20b66 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:06.819740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 616/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:13:06 2022] GET /identity/v3/role_assignments?user.id=bbd74e1c4445439fa55b53f56f2befce&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:08.673381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106492c-dcd7-4e3a-ab0f-bde5755455b5 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:08.673937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106492c-dcd7-4e3a-ab0f-bde5755455b5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:08.673937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106492c-dcd7-4e3a-ab0f-bde5755455b5 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:08.675237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 645/1261] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:13:08.680369 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf4c02-04f7-4ca0-9676-7ce88d62459c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:08.680761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf4c02-04f7-4ca0-9676-7ce88d62459c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:08.680915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf4c02-04f7-4ca0-9676-7ce88d62459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:08.699857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-66bf4c02-04f7-4ca0-9676-7ce88d62459c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:13:08.701038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-66bf4c02-04f7-4ca0-9676-7ce88d62459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:13:08.765995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 617/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:13:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:13:09.036943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106492c-dcd7-4e3a-ab0f-bde5755455b5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:09.047839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:09.141382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106492c-dcd7-4e3a-ab0f-bde5755455b5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:09.173423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:09.174028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:09.174300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:09.174561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:09.184234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:13:09.188886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:09.189886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:09.191071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 646/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:09.195873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf4c02-04f7-4ca0-9676-7ce88d62459c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:09.213908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:09.292037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf4c02-04f7-4ca0-9676-7ce88d62459c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:09.327646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:09.328314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:09.328614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:09.328914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:09.329653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:09.329992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:09.331598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:09.340799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 618/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:09.347492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:09.424565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:09.455836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17c1c7-22ba-429e-a26f-5d12fbb65fdb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:09.488505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:09.489109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:09.489381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:09.489646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:09.499282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:09.500730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:09.514859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:09.515992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:09.516936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:09.516936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:09.516936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:09.516936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 647/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:09.521686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:09.601057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:09.620122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4f106-d940-4f1c-afdc-fefff4c0af79 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:09.651644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:09.652226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:09.652500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:09.652766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:09.653391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:09.653686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:09.655552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:09.666653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 619/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:09.672872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:09.769058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b725e8-d535-4ec9-a722-4d640dcda51d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:09.788284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:09.802384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:09.803000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:09.803279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:09.803583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:09.810792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:09.812260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:13:09.823340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:09.824458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:09.825771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 648/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:09.830702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:09.925880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2227b5b-12f4-4c8e-8d29-cc48aaed84a6 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:09.959010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:09.959624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:09.959903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:09.960173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:09.960882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:09.961182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:09.962603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:09.971513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:09.980120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 620/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Sep 6 04:13:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:09.985884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:10.082415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562fcf8-16a5-4d39-a522-5bbfa8e088df None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:10.114482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:10.115091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:10.115366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:10.115665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:10.126348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:10.127814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:10.142191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:10.143294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:10.144449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:10.144449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:10.144449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:10.144449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 649/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:10.149158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:10.244449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62851b3f-f432-4270-8800-29f9a67eb241 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:10.277845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:10.278425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:10.278702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:10.278972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:10.279660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:10.279960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:10.281313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:10.294791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 621/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:10.300559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:10.335459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:10.408747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ba61-21fc-4cf3-ae33-7c7cc27a3395 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:10.440522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:10.441127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:10.441400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:10.441664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:10.448088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:10.449521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:13:10.461450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:10.462476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:10.463618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 650/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:10.468369 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:10.525921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:10.566852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c948f0-c419-4517-8b57-6e15d90710f9 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:10.598531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08bba2-9310-4f52-9955-228547614793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:10.599115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08bba2-9310-4f52-9955-228547614793 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:10.599404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08bba2-9310-4f52-9955-228547614793 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:10.599673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08bba2-9310-4f52-9955-228547614793 None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:10.600348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08bba2-9310-4f52-9955-228547614793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:10.600647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08bba2-9310-4f52-9955-228547614793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:10.602054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08bba2-9310-4f52-9955-228547614793 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:10.613958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 622/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:13:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:10.619786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:10.708862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:10.718130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cf7e-d56e-4394-80c9-3de21304bd07 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:10.749687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1c9dd-177b-4e73-bbfd-c8c9403973b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:10.750329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c9dd-177b-4e73-bbfd-c8c9403973b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:10.750605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c9dd-177b-4e73-bbfd-c8c9403973b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:10.750877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c9dd-177b-4e73-bbfd-c8c9403973b5 None admin] PATH_INFO: `/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/bbd74e1c4445439fa55b53f56f2befce/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:10.752777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1c9dd-177b-4e73-bbfd-c8c9403973b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c451f44fb2d4403c97f1c6bd42584fd1, user_id=bbd74e1c4445439fa55b53f56f2befce, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:10.754204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1c9dd-177b-4e73-bbfd-c8c9403973b5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:10.768009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 651/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Sep 6 04:13:10 2022] PUT /identity/v3/projects/c451f44fb2d4403c97f1c6bd42584fd1/users/bbd74e1c4445439fa55b53f56f2befce/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:13:12.641035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856a98-e6e1-4c4e-9921-5eb856ded8a7 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:12.641589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856a98-e6e1-4c4e-9921-5eb856ded8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:12.641589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856a98-e6e1-4c4e-9921-5eb856ded8a7 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:12.642906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 623/1274] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:13:12.648118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e013-66fe-4e17-827f-7694ebc34e6f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:12.648522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e013-66fe-4e17-827f-7694ebc34e6f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:12.648659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e013-66fe-4e17-827f-7694ebc34e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:12.666358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-80d0e013-66fe-4e17-827f-7694ebc34e6f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:13:12.667573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-80d0e013-66fe-4e17-827f-7694ebc34e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:13:12.731479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 652/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:13:13.011922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21856a98-e6e1-4c4e-9921-5eb856ded8a7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:13.114246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21856a98-e6e1-4c4e-9921-5eb856ded8a7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:13.131891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:13.149160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:13.149780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:13.150053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:13.150317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:13.160653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 04:13:13.165411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:13.167345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:13.168514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 624/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Sep 6 04:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:13.173023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0e013-66fe-4e17-827f-7694ebc34e6f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:13.251119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:13.269536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0e013-66fe-4e17-827f-7694ebc34e6f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:13.302856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:13.303475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:13.303752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:13.304015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:13.304661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:13.304956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:13.306297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:13.313958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 653/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Sep 6 04:13:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:13.319612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:13.431031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce3804-8bbc-48d7-a0a6-6d718d6a5417 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:13.463219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:13.463857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:13.464133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:13.464399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:13.474490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:13.475980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:13.490491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:13.491642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:13.492585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:13.492585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:13.492585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:13.492585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 625/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:13.497552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:13.595139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a719d-bf1b-44c0-8578-ed108097b9f3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:13.627533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:13.628124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:13.628399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:13.628668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:13.629294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:13.629595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:13.631193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:13.642901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 654/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:13.648539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:13.678732 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:13.745150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd53487-bfb8-490f-8c1d-1449982b9d3d None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:13.777500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:13.778095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:13.778367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:13.778630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:13.786092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:13.787582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 04:13:13.799415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:13.800595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:13.801988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 626/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:13.806220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:13.809970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:13.903079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dc9a5-de06-4715-a8c9-8a27cb4c73e1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:13.934826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:13.935944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:13.936223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:13.936489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:13.937201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:13.937501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:13.938906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:13.956295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 655/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Sep 6 04:13:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:13.961849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:14.049710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:14.059181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c882a7-b245-4f63-ba22-a8acbd1ba7e5 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:14.091848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:14.092445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:14.092721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:14.092991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:14.157536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:14.158900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:14.242973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:14.253750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 627/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Sep 6 04:13:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 04:13:14.259908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:14.318756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:14.355047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ccc85-bf61-4244-97e6-a86209d1a530 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:14.388123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:14.388753 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:14.389027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:14.389295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:14.398855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:14.400308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 04:13:14.414309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:14.415516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 04:13:14.416718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 04:13:14.416718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 04:13:14.416718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:14.416718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 656/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:14.421339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:14.522886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62e4b-df70-4a3b-8e6b-f76751a3e3a9 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:14.555424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:14.556016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:14.556292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:14.556559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:14.557187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:14.557485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:14.558844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:14.570093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 628/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Sep 6 04:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:14.575767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:14.672394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96347-1971-42d2-b130-f8fe57e79ef6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:14.685146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:14.704471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:14.705074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:14.705349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:14.705619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:14.711976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:14.713399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 04:13:14.724822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:14.725881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 06 04:13:14.727210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 657/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Sep 6 04:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:14.731595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:14.780255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:14.829464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19837820-4a36-484c-ac92-e05715f5ea1e None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:14.868544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793acf87-cc08-4316-a7ab-13559332198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:14.869143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793acf87-cc08-4316-a7ab-13559332198b None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:14.869417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793acf87-cc08-4316-a7ab-13559332198b None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:14.869688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793acf87-cc08-4316-a7ab-13559332198b None admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:14.870658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793acf87-cc08-4316-a7ab-13559332198b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:14.870956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793acf87-cc08-4316-a7ab-13559332198b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:14.872403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793acf87-cc08-4316-a7ab-13559332198b None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:14.884066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 629/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Sep 6 04:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:14.890157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:14.988809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5ca2a-6687-4a8c-9b96-0a400bb1e56f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:15.021973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700d515-c93b-43fd-9aaf-e19012d1b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:15.022563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d515-c93b-43fd-9aaf-e19012d1b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:15.022839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d515-c93b-43fd-9aaf-e19012d1b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:15.023113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d515-c93b-43fd-9aaf-e19012d1b7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:15.023864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d515-c93b-43fd-9aaf-e19012d1b7b5 None admin] RBAC: Adding query filter params (role.id=4d01a55cb82849ae8115935ad6f0352a, scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1, user.id=bbd74e1c4445439fa55b53f56f2befce) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:15.024171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d515-c93b-43fd-9aaf-e19012d1b7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:15.025586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d515-c93b-43fd-9aaf-e19012d1b7b5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:15.031732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 658/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Sep 6 04:13:14 2022] GET /identity/v3/role_assignments?user.id=bbd74e1c4445439fa55b53f56f2befce&scope.project.id=c451f44fb2d4403c97f1c6bd42584fd1&role.id=4d01a55cb82849ae8115935ad6f0352a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:16.945332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3848-b5b9-404e-a2b0-f5f9615e7924 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:16.945921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3848-b5b9-404e-a2b0-f5f9615e7924 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:16.945921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3848-b5b9-404e-a2b0-f5f9615e7924 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:16.947217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 630/1288] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:13:16.952195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fae36-4442-4bab-ba84-f72479ddb1c6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:16.952628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fae36-4442-4bab-ba84-f72479ddb1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:16.952732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fae36-4442-4bab-ba84-f72479ddb1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:16.970807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b89fae36-4442-4bab-ba84-f72479ddb1c6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:13:16.972002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b89fae36-4442-4bab-ba84-f72479ddb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:13:17.001178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:17.038331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 659/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:13:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:13:17.314150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3848-b5b9-404e-a2b0-f5f9615e7924 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:17.428831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3848-b5b9-404e-a2b0-f5f9615e7924 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:17.440930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:17.464668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:17.465284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:17.465562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:17.465832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:17.466427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:17.467843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:17.476457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:17.477700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:17.478754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 631/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:13:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:17.484091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fae36-4442-4bab-ba84-f72479ddb1c6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:17.579361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fae36-4442-4bab-ba84-f72479ddb1c6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:17.612056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca7c4-78dd-495a-b590-f09843419e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:17.612641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca7c4-78dd-495a-b590-f09843419e92 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:17.612915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca7c4-78dd-495a-b590-f09843419e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:17.613184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca7c4-78dd-495a-b590-f09843419e92 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:17.613796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ca7c4-78dd-495a-b590-f09843419e92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:17.614091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ca7c4-78dd-495a-b590-f09843419e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:17.615483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ca7c4-78dd-495a-b590-f09843419e92 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:17.620047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 660/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Sep 6 04:13:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:17.626213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:17.723261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508b07a-5442-45fd-9e8f-70f11c63d697 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:17.755532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf3f8b-b671-4bd6-bbf8-a8ff391967e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:17.756113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3f8b-b671-4bd6-bbf8-a8ff391967e7 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:17.756385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3f8b-b671-4bd6-bbf8-a8ff391967e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:17.756654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3f8b-b671-4bd6-bbf8-a8ff391967e7 None admin] PATH_INFO: `/v3/services` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:17.757273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf3f8b-b671-4bd6-bbf8-a8ff391967e7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:17.757571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf3f8b-b671-4bd6-bbf8-a8ff391967e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:17.758913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf3f8b-b671-4bd6-bbf8-a8ff391967e7 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:17.763156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 632/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Sep 6 04:13:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:19.645234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc3358-2dd9-432c-b5ad-a435e41463aa None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:19.645805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc3358-2dd9-432c-b5ad-a435e41463aa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:19.645805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc3358-2dd9-432c-b5ad-a435e41463aa None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:19.647118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 661/1293] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:13:19.652980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9d586-0b15-48fe-b1f2-9307b994cb5d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:19.653359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9d586-0b15-48fe-b1f2-9307b994cb5d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:19.653527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9d586-0b15-48fe-b1f2-9307b994cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:19.671727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0fe9d586-0b15-48fe-b1f2-9307b994cb5d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:13:19.672907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0fe9d586-0b15-48fe-b1f2-9307b994cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:13:19.701473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:19.737470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 633/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:13:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:13:20.002833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc3358-2dd9-432c-b5ad-a435e41463aa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:20.034008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:20.102257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc3358-2dd9-432c-b5ad-a435e41463aa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:20.134986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781b7e-4191-489c-ba13-198421c29fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:20.135601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781b7e-4191-489c-ba13-198421c29fb5 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:20.135880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781b7e-4191-489c-ba13-198421c29fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:20.136147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781b7e-4191-489c-ba13-198421c29fb5 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:20.136782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781b7e-4191-489c-ba13-198421c29fb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:20.138682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781b7e-4191-489c-ba13-198421c29fb5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:20.152033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 662/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Sep 6 04:13:20 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:13:22.051134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c861-eb46-4a4f-9fb9-0b1ccde6d294 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:22.051616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c861-eb46-4a4f-9fb9-0b1ccde6d294 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:22.051728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c861-eb46-4a4f-9fb9-0b1ccde6d294 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:22.053051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 634/1296] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:13:22.058110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdd0e-7bf4-4170-9fcf-e8cfd24917c8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:22.058529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdd0e-7bf4-4170-9fcf-e8cfd24917c8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:22.058651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdd0e-7bf4-4170-9fcf-e8cfd24917c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:22.076714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-276fdd0e-7bf4-4170-9fcf-e8cfd24917c8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:13:22.077879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-276fdd0e-7bf4-4170-9fcf-e8cfd24917c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:13:22.148759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 663/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:13:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:13:22.415954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c861-eb46-4a4f-9fb9-0b1ccde6d294 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:22.514309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c861-eb46-4a4f-9fb9-0b1ccde6d294 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:22.546495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:22.547095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:22.547365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:22.547657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:22.548221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:22.549568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:22.557971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:22.559116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:22.560171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 635/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:13:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:22.564924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fdd0e-7bf4-4170-9fcf-e8cfd24917c8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:22.583045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:22.661686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fdd0e-7bf4-4170-9fcf-e8cfd24917c8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:22.693560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:22.694149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:22.694425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:22.694692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:22.695306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:22.695629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:22.696981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:22.702412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 664/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Sep 6 04:13:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:22.708415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:22.738837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:22.804386 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d35cc-0fa7-48ad-9c80-0ee7cc13224c None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:22.836477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77863e-0ac4-4591-9810-cb242fc594db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:22.837057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77863e-0ac4-4591-9810-cb242fc594db None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:22.837335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77863e-0ac4-4591-9810-cb242fc594db None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:22.837601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77863e-0ac4-4591-9810-cb242fc594db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:22.838284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77863e-0ac4-4591-9810-cb242fc594db None admin] RBAC: Adding query filter params (interface=public, service_id=13df0480c00541899734078d5297e835, region_id=RegionOne) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:22.838585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77863e-0ac4-4591-9810-cb242fc594db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:22.839961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77863e-0ac4-4591-9810-cb242fc594db None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:22.845335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 636/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Sep 6 04:13:22 2022] GET /identity/v3/endpoints?service_id=13df0480c00541899734078d5297e835&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:22.850738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:22.929224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:22.947905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f3bf-52ec-4f85-95ca-103a20bb6103 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:22.980176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124da75a-4895-4167-a5dc-9cbcc4d873ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:22.980766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da75a-4895-4167-a5dc-9cbcc4d873ff None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:22.981042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da75a-4895-4167-a5dc-9cbcc4d873ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:22.981309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da75a-4895-4167-a5dc-9cbcc4d873ff None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:22.981929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da75a-4895-4167-a5dc-9cbcc4d873ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:22.983329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da75a-4895-4167-a5dc-9cbcc4d873ff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:22.990012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 665/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Sep 6 04:13:22 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:13:24.887517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79535-8b78-4a20-a8b2-8aca647cf793 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:24.888045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79535-8b78-4a20-a8b2-8aca647cf793 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:24.888045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79535-8b78-4a20-a8b2-8aca647cf793 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:24.889397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 637/1302] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:13:24.894575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37fcf9-de03-43ee-94c5-8198a428a0f3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:24.895018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37fcf9-de03-43ee-94c5-8198a428a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:24.895119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37fcf9-de03-43ee-94c5-8198a428a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:24.913028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8b37fcf9-de03-43ee-94c5-8198a428a0f3 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:13:24.914297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8b37fcf9-de03-43ee-94c5-8198a428a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:13:24.980617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 666/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:13:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 04:13:25.257127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79535-8b78-4a20-a8b2-8aca647cf793 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:25.353663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:25.361291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79535-8b78-4a20-a8b2-8aca647cf793 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:25.400167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:25.400786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:25.401070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:25.401340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:25.401916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:25.403289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 04:13:25.412227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 04:13:25.413441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application with Lock( Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self._enter() Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application return self.creator() Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application created_value = creator( Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: ERROR keystone.server.flask.application Sep 06 04:13:25.414505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 638/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Sep 6 04:13:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 04:13:25.419543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37fcf9-de03-43ee-94c5-8198a428a0f3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:25.493026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:25.516204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37fcf9-de03-43ee-94c5-8198a428a0f3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:25.549429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1214566-959d-418e-bdd2-5c8c59f4e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:25.550022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214566-959d-418e-bdd2-5c8c59f4e684 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:25.550298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214566-959d-418e-bdd2-5c8c59f4e684 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:25.550566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214566-959d-418e-bdd2-5c8c59f4e684 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:25.551182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1214566-959d-418e-bdd2-5c8c59f4e684 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:13:25.551511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1214566-959d-418e-bdd2-5c8c59f4e684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:25.552872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1214566-959d-418e-bdd2-5c8c59f4e684 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:25.557809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 667/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Sep 6 04:13:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:13:25.563800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:13:25.662683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f41860-4bd3-40f6-9ca6-83834a72a108 None admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:13:25.693964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a3515-387f-49a4-a3b8-58cfdff95f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:13:25.694542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3515-387f-49a4-a3b8-58cfdff95f16 None admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:13:25.694814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3515-387f-49a4-a3b8-58cfdff95f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:13:25.695077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3515-387f-49a4-a3b8-58cfdff95f16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:13:25.695761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3515-387f-49a4-a3b8-58cfdff95f16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:13:25.697136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3515-387f-49a4-a3b8-58cfdff95f16 None admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:13:25.715822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 639/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:13:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:13:35.555415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=30 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:13:35.711757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:29.021675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a95a-1107-4102-a63b-cfbe5360c597 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:29.022113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a95a-1107-4102-a63b-cfbe5360c597 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:29.022202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a95a-1107-4102-a63b-cfbe5360c597 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:29.027764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 668/1307] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:29.029165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f68a1b-33b5-4fdf-aca0-70bfaae363bd None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:29.029621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f68a1b-33b5-4fdf-aca0-70bfaae363bd None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:29.029703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f68a1b-33b5-4fdf-aca0-70bfaae363bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:29.134554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-20f68a1b-33b5-4fdf-aca0-70bfaae363bd None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:29.136584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-20f68a1b-33b5-4fdf-aca0-70bfaae363bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:29.259586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 640/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:14:29.554939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2197-c206-4bec-bbc4-2afe1bb58982 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:29.555388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2197-c206-4bec-bbc4-2afe1bb58982 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:29.555786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2197-c206-4bec-bbc4-2afe1bb58982 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:29.557991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 669/1309] 10.222.0.18 () {54 vars in 965 bytes} [Tue Sep 6 04:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:29.563887 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414aab6-d8ca-4e22-b597-7c938b273e1a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:29.564175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414aab6-d8ca-4e22-b597-7c938b273e1a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:29.564452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414aab6-d8ca-4e22-b597-7c938b273e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:29.650464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-4414aab6-d8ca-4e22-b597-7c938b273e1a None None] MFA Rules not processed for user `bf28e8b35a8246778b66c59164947add`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:29.651761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4414aab6-d8ca-4e22-b597-7c938b273e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:29.674895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:29.739312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 641/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Sep 6 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:29.748922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b2197-c206-4bec-bbc4-2afe1bb58982 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:29.750772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-363b2197-c206-4bec-bbc4-2afe1bb58982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:29.881414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b2197-c206-4bec-bbc4-2afe1bb58982 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:29.958716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f547b-534e-4461-8d04-e8404a3e8b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:29.959330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f547b-534e-4461-8d04-e8404a3e8b5b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:29.959637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f547b-534e-4461-8d04-e8404a3e8b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:29.959912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f547b-534e-4461-8d04-e8404a3e8b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:29.961506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-481f547b-534e-4461-8d04-e8404a3e8b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:30.021554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:30.078703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f547b-534e-4461-8d04-e8404a3e8b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:30.080168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f547b-534e-4461-8d04-e8404a3e8b5b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:30.099041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 670/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:32.328190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9f2b-cf65-4e13-b4be-320e3aa3460b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:32.328701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9f2b-cf65-4e13-b4be-320e3aa3460b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:32.328701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9f2b-cf65-4e13-b4be-320e3aa3460b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:32.330162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 642/1312] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:32.335110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c2c7d-a2fb-4d51-8760-e1a319c4c5a1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:32.335532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c2c7d-a2fb-4d51-8760-e1a319c4c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:32.335694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c2c7d-a2fb-4d51-8760-e1a319c4c5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:32.430217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-705c2c7d-a2fb-4d51-8760-e1a319c4c5a1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:32.431554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-705c2c7d-a2fb-4d51-8760-e1a319c4c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:32.530679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 671/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:32.814075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9f2b-cf65-4e13-b4be-320e3aa3460b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:32.815678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d0db9f2b-cf65-4e13-b4be-320e3aa3460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:32.919650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9f2b-cf65-4e13-b4be-320e3aa3460b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:32.990504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:32.993533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83dfcc-1b85-4430-ba9e-bdc5da140948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:32.994401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dfcc-1b85-4430-ba9e-bdc5da140948 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:32.994866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dfcc-1b85-4430-ba9e-bdc5da140948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:32.995310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dfcc-1b85-4430-ba9e-bdc5da140948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:32.997217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-af83dfcc-1b85-4430-ba9e-bdc5da140948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:33.105456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83dfcc-1b85-4430-ba9e-bdc5da140948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:33.106812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83dfcc-1b85-4430-ba9e-bdc5da140948 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:33.124605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 643/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:35.333920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441907d-20ad-4858-8a90-7afbcad1127e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:35.334492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441907d-20ad-4858-8a90-7afbcad1127e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:35.334492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441907d-20ad-4858-8a90-7afbcad1127e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:35.335742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 672/1315] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:35.340961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df137-45d6-403a-93f9-cd72237ae5e9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:35.341360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df137-45d6-403a-93f9-cd72237ae5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:35.341499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df137-45d6-403a-93f9-cd72237ae5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:35.406576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-793df137-45d6-403a-93f9-cd72237ae5e9 None None] MFA Rules not processed for user `a740d61e1d9f4107897b20c8ed8d9140`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:35.407803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-793df137-45d6-403a-93f9-cd72237ae5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:35.458462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:35.505641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 644/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:35.819047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441907d-20ad-4858-8a90-7afbcad1127e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:35.820658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2441907d-20ad-4858-8a90-7afbcad1127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:35.830643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:35.932235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441907d-20ad-4858-8a90-7afbcad1127e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:36.016064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b82c5-f409-492e-8be6-5539a45ababe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:36.016689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b82c5-f409-492e-8be6-5539a45ababe service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:36.016964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b82c5-f409-492e-8be6-5539a45ababe service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:36.017236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b82c5-f409-492e-8be6-5539a45ababe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:36.018843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-413b82c5-f409-492e-8be6-5539a45ababe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:36.087690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:36.140296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b82c5-f409-492e-8be6-5539a45ababe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:36.141737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b82c5-f409-492e-8be6-5539a45ababe service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:36.164064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 673/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:38.536260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21e71-e3fd-4d81-abe9-064d3100045a None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:38.536773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21e71-e3fd-4d81-abe9-064d3100045a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:38.536773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21e71-e3fd-4d81-abe9-064d3100045a None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:38.538138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 645/1318] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:38.543827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6161-5fe8-4a4c-8f06-884412032aab None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:38.544244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6161-5fe8-4a4c-8f06-884412032aab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:38.544372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6161-5fe8-4a4c-8f06-884412032aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:38.608853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-389f6161-5fe8-4a4c-8f06-884412032aab None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:38.610047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-389f6161-5fe8-4a4c-8f06-884412032aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:38.709012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 674/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:38.990284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b21e71-e3fd-4d81-abe9-064d3100045a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:38.991856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-84b21e71-e3fd-4d81-abe9-064d3100045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:39.093664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b21e71-e3fd-4d81-abe9-064d3100045a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:39.165760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078adb-979b-4aa4-8d35-77c9ea3756c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:39.166386 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078adb-979b-4aa4-8d35-77c9ea3756c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:39.166662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078adb-979b-4aa4-8d35-77c9ea3756c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:39.166929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078adb-979b-4aa4-8d35-77c9ea3756c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:39.168557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-90078adb-979b-4aa4-8d35-77c9ea3756c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:39.175309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:39.275171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078adb-979b-4aa4-8d35-77c9ea3756c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:39.277131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078adb-979b-4aa4-8d35-77c9ea3756c4 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:39.295295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 646/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:41.820314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82705b8-12a2-4fa8-b617-6e3c084e298f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:41.820854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82705b8-12a2-4fa8-b617-6e3c084e298f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:41.821044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82705b8-12a2-4fa8-b617-6e3c084e298f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:41.822578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 675/1321] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:41.828047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5b6b-5da0-429b-bb2a-01fbda20014d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:41.828470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5b6b-5da0-429b-bb2a-01fbda20014d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:41.828590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5b6b-5da0-429b-bb2a-01fbda20014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:41.894602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f52a5b6b-5da0-429b-bb2a-01fbda20014d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:41.895835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f52a5b6b-5da0-429b-bb2a-01fbda20014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:41.954846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:41.994163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 647/1322] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:42.278796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82705b8-12a2-4fa8-b617-6e3c084e298f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:42.280510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b82705b8-12a2-4fa8-b617-6e3c084e298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:42.299565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:42.386402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82705b8-12a2-4fa8-b617-6e3c084e298f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:42.457972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08b56-8374-4c9e-95d8-00dacb6063c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:42.458601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08b56-8374-4c9e-95d8-00dacb6063c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:42.458871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08b56-8374-4c9e-95d8-00dacb6063c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:42.459144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08b56-8374-4c9e-95d8-00dacb6063c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:42.460781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ece08b56-8374-4c9e-95d8-00dacb6063c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:42.531795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:42.571359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08b56-8374-4c9e-95d8-00dacb6063c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:42.573490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08b56-8374-4c9e-95d8-00dacb6063c9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:42.592032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 676/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:44.576956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820b72-cd5f-4755-9ecb-2c340bc1f9e6 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:44.577461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820b72-cd5f-4755-9ecb-2c340bc1f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:44.577461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820b72-cd5f-4755-9ecb-2c340bc1f9e6 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:44.578780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 648/1324] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:44.584077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529d48-a43a-40dd-bde3-e62ed7c6d92c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:44.584514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529d48-a43a-40dd-bde3-e62ed7c6d92c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:44.584612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529d48-a43a-40dd-bde3-e62ed7c6d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:44.650171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-97529d48-a43a-40dd-bde3-e62ed7c6d92c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:44.651362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-97529d48-a43a-40dd-bde3-e62ed7c6d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:44.746075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 677/1325] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:45.043275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640405-232c-4533-93c1-76cc06a07a65 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:45.043694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640405-232c-4533-93c1-76cc06a07a65 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:45.044034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640405-232c-4533-93c1-76cc06a07a65 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:45.045446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 649/1326] 10.222.0.18 () {54 vars in 965 bytes} [Tue Sep 6 04:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:45.051289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9880ced-10fe-4fd0-9ee4-aa3f46cc2599 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:45.051661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9880ced-10fe-4fd0-9ee4-aa3f46cc2599 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:45.051998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9880ced-10fe-4fd0-9ee4-aa3f46cc2599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:45.082953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:45.131332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a9880ced-10fe-4fd0-9ee4-aa3f46cc2599 None None] MFA Rules not processed for user `bf28e8b35a8246778b66c59164947add`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:45.132539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a9880ced-10fe-4fd0-9ee4-aa3f46cc2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:45.209550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 678/1327] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Sep 6 04:14:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:45.218455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c640405-232c-4533-93c1-76cc06a07a65 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:45.220002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0c640405-232c-4533-93c1-76cc06a07a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:45.324888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c640405-232c-4533-93c1-76cc06a07a65 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:45.399079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b819-159f-48a2-97ac-19dc69242044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:45.399658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b819-159f-48a2-97ac-19dc69242044 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:45.400464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b819-159f-48a2-97ac-19dc69242044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:45.400730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b819-159f-48a2-97ac-19dc69242044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:45.402319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-56c9b819-159f-48a2-97ac-19dc69242044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:45.418702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:45.509081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b819-159f-48a2-97ac-19dc69242044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:45.510552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b819-159f-48a2-97ac-19dc69242044 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:45.529134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 650/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:47.701157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38730b-ab60-4763-9b8c-63a384528991 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:47.701737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38730b-ab60-4763-9b8c-63a384528991 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:47.701737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38730b-ab60-4763-9b8c-63a384528991 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:47.703059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 679/1329] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:47.708212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca510-84e3-41c0-99ee-472984e1adb2 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:47.708618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca510-84e3-41c0-99ee-472984e1adb2 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:47.708759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca510-84e3-41c0-99ee-472984e1adb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:47.792393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f96ca510-84e3-41c0-99ee-472984e1adb2 None None] MFA Rules not processed for user `a740d61e1d9f4107897b20c8ed8d9140`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:47.793610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f96ca510-84e3-41c0-99ee-472984e1adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:47.862819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:47.894511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 651/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:48.176747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38730b-ab60-4763-9b8c-63a384528991 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:48.178275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cf38730b-ab60-4763-9b8c-63a384528991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:48.281892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38730b-ab60-4763-9b8c-63a384528991 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:48.301749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:48.357890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b60745-fc08-477d-b904-6353b1bd9f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:48.358502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60745-fc08-477d-b904-6353b1bd9f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:48.358777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60745-fc08-477d-b904-6353b1bd9f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:48.359046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60745-fc08-477d-b904-6353b1bd9f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:48.360710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b0b60745-fc08-477d-b904-6353b1bd9f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:48.503953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b60745-fc08-477d-b904-6353b1bd9f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:48.505533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b60745-fc08-477d-b904-6353b1bd9f6f service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:48.526185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 680/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:50.828850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e890-ae36-4ba9-bce7-a914d26edea7 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:50.829388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e890-ae36-4ba9-bce7-a914d26edea7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:50.829388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e890-ae36-4ba9-bce7-a914d26edea7 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:50.830721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 652/1332] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:50.835785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d8a8f-d9d6-4837-bbdc-b85192997d8f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:50.836211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d8a8f-d9d6-4837-bbdc-b85192997d8f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:50.836326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d8a8f-d9d6-4837-bbdc-b85192997d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:50.899164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:50.902031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-de3d8a8f-d9d6-4837-bbdc-b85192997d8f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:50.903787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-de3d8a8f-d9d6-4837-bbdc-b85192997d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:50.998985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 681/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:51.276221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e890-ae36-4ba9-bce7-a914d26edea7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:51.277749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d152e890-ae36-4ba9-bce7-a914d26edea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:51.380468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e890-ae36-4ba9-bce7-a914d26edea7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:51.452416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12855a92-9106-49b3-be65-25bfac993841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:51.453016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12855a92-9106-49b3-be65-25bfac993841 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:51.453293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12855a92-9106-49b3-be65-25bfac993841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:51.453563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12855a92-9106-49b3-be65-25bfac993841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:51.455160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-12855a92-9106-49b3-be65-25bfac993841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:51.483780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:51.562842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12855a92-9106-49b3-be65-25bfac993841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:51.564229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12855a92-9106-49b3-be65-25bfac993841 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:51.581609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 653/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:53.515516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ebb30-2ac2-47f9-8c96-12d6997eec88 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:53.516045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ebb30-2ac2-47f9-8c96-12d6997eec88 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:53.516045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ebb30-2ac2-47f9-8c96-12d6997eec88 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:53.517409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 682/1335] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:53.522542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0bcb5-c48e-46c1-a967-8d8f40980082 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:53.522979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0bcb5-c48e-46c1-a967-8d8f40980082 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:53.523072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0bcb5-c48e-46c1-a967-8d8f40980082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:53.587176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-04f0bcb5-c48e-46c1-a967-8d8f40980082 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:53.588401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-04f0bcb5-c48e-46c1-a967-8d8f40980082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:53.659595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:53.682656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 654/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:53.967329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ebb30-2ac2-47f9-8c96-12d6997eec88 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:53.968884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a4ebb30-2ac2-47f9-8c96-12d6997eec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:54.069163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ebb30-2ac2-47f9-8c96-12d6997eec88 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:54.097713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:54.141511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9fd7c-a087-46f6-815a-cd99d5baccef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:54.142102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9fd7c-a087-46f6-815a-cd99d5baccef service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:54.142371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9fd7c-a087-46f6-815a-cd99d5baccef service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:54.142633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9fd7c-a087-46f6-815a-cd99d5baccef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:54.144292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-08f9fd7c-a087-46f6-815a-cd99d5baccef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:54.249065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9fd7c-a087-46f6-815a-cd99d5baccef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:54.250425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9fd7c-a087-46f6-815a-cd99d5baccef service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:54.269057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 683/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:14:56.594686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d7c23-e9f3-413c-a9a1-171b041eca3a None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:56.595244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d7c23-e9f3-413c-a9a1-171b041eca3a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:56.595244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d7c23-e9f3-413c-a9a1-171b041eca3a None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:56.596668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 655/1338] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:14:56.601701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782a81-8cee-42e0-933c-a87778957ed4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:56.602123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782a81-8cee-42e0-933c-a87778957ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:56.602300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782a81-8cee-42e0-933c-a87778957ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:56.668093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d9782a81-8cee-42e0-933c-a87778957ed4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:14:56.669227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d9782a81-8cee-42e0-933c-a87778957ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:56.677269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:56.764078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 684/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:14:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:14:57.047388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d7c23-e9f3-413c-a9a1-171b041eca3a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:14:57.048939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-760d7c23-e9f3-413c-a9a1-171b041eca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:57.151091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d7c23-e9f3-413c-a9a1-171b041eca3a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:14:57.222358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130dfe7-5c15-4ba1-abcd-b6cfaf974bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:14:57.222945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130dfe7-5c15-4ba1-abcd-b6cfaf974bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:14:57.223220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130dfe7-5c15-4ba1-abcd-b6cfaf974bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:14:57.223519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130dfe7-5c15-4ba1-abcd-b6cfaf974bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:14:57.225083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f130dfe7-5c15-4ba1-abcd-b6cfaf974bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:14:57.260040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:14:57.332278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130dfe7-5c15-4ba1-abcd-b6cfaf974bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:14:57.333719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130dfe7-5c15-4ba1-abcd-b6cfaf974bb7 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:14:57.352919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 656/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:14:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:01.285933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c155224-b20d-4cf0-92ed-989915b789b6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:01.286402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c155224-b20d-4cf0-92ed-989915b789b6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:01.286515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c155224-b20d-4cf0-92ed-989915b789b6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:01.287861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 685/1341] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:01.293797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd517-b962-484f-9224-3d2a9b6faaf4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:01.294244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd517-b962-484f-9224-3d2a9b6faaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:01.294495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd517-b962-484f-9224-3d2a9b6faaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:01.364032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0c3fd517-b962-484f-9224-3d2a9b6faaf4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:01.365253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0c3fd517-b962-484f-9224-3d2a9b6faaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:01.450746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:01.462939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 657/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:01.745695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c155224-b20d-4cf0-92ed-989915b789b6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:01.747317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c155224-b20d-4cf0-92ed-989915b789b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:01.850443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c155224-b20d-4cf0-92ed-989915b789b6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:01.890327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:01.927472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298aea2c-2f40-4872-a596-aa6f0034b72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:01.928075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aea2c-2f40-4872-a596-aa6f0034b72c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:01.928350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aea2c-2f40-4872-a596-aa6f0034b72c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:01.928615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aea2c-2f40-4872-a596-aa6f0034b72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:01.930717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-298aea2c-2f40-4872-a596-aa6f0034b72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:02.040261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298aea2c-2f40-4872-a596-aa6f0034b72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:02.041704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298aea2c-2f40-4872-a596-aa6f0034b72c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:02.060097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 686/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:04.552595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f750-e5ae-406e-8856-778abe34492b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:04.553155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f750-e5ae-406e-8856-778abe34492b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:04.553155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f750-e5ae-406e-8856-778abe34492b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:04.554702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 658/1344] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:04.560101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c3602-a073-4b49-ab27-5222ba8fb1a5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:04.560631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c3602-a073-4b49-ab27-5222ba8fb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:04.560631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c3602-a073-4b49-ab27-5222ba8fb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:04.632552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7a5c3602-a073-4b49-ab27-5222ba8fb1a5 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:04.634348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7a5c3602-a073-4b49-ab27-5222ba8fb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:04.653160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:04.735795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 687/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:05.022428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79f750-e5ae-406e-8856-778abe34492b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:05.024711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2d79f750-e5ae-406e-8856-778abe34492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:05.128948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79f750-e5ae-406e-8856-778abe34492b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:05.201006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d44b-b25e-4328-9a67-94cd68c3e515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:05.201601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d44b-b25e-4328-9a67-94cd68c3e515 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:05.201875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d44b-b25e-4328-9a67-94cd68c3e515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:05.202140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d44b-b25e-4328-9a67-94cd68c3e515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:05.203738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-da55d44b-b25e-4328-9a67-94cd68c3e515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:05.246967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:05.315969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55d44b-b25e-4328-9a67-94cd68c3e515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:05.317360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55d44b-b25e-4328-9a67-94cd68c3e515 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:05.339354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 659/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:09.187273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff646-4c09-4097-a83a-b77909ab5e41 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:09.187853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff646-4c09-4097-a83a-b77909ab5e41 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:09.187853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff646-4c09-4097-a83a-b77909ab5e41 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:09.189127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 688/1347] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:09.194398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72f76-f583-4901-95bb-9a631acd7728 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:09.194831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72f76-f583-4901-95bb-9a631acd7728 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:09.194980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72f76-f583-4901-95bb-9a631acd7728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:09.264713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-22c72f76-f583-4901-95bb-9a631acd7728 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:09.265936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-22c72f76-f583-4901-95bb-9a631acd7728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:09.391327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:09.395420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 660/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:09.675675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ff646-4c09-4097-a83a-b77909ab5e41 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:09.677255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1e6ff646-4c09-4097-a83a-b77909ab5e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:09.785534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ff646-4c09-4097-a83a-b77909ab5e41 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:09.832732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:09.860035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdb2a1-a183-4373-92d4-c2bb31c8210b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:09.860635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdb2a1-a183-4373-92d4-c2bb31c8210b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:09.860906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdb2a1-a183-4373-92d4-c2bb31c8210b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:09.861169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdb2a1-a183-4373-92d4-c2bb31c8210b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:09.862732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b1bdb2a1-a183-4373-92d4-c2bb31c8210b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:09.975786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdb2a1-a183-4373-92d4-c2bb31c8210b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:09.977279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdb2a1-a183-4373-92d4-c2bb31c8210b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:09.996354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 689/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:14.930538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf27ae-5a79-4192-ab1b-c9086a498760 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:14.931006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf27ae-5a79-4192-ab1b-c9086a498760 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:14.931109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf27ae-5a79-4192-ab1b-c9086a498760 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:14.932963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 661/1350] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:14.937978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2186e25-719d-426e-b0d5-2a3a668d5963 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:14.938393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2186e25-719d-426e-b0d5-2a3a668d5963 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:14.938703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2186e25-719d-426e-b0d5-2a3a668d5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:15.049195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e2186e25-719d-426e-b0d5-2a3a668d5963 None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:15.050383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e2186e25-719d-426e-b0d5-2a3a668d5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:15.071961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:15.165286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 690/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:15:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:15:19.440715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f7390-9a51-4554-80b0-60f52d9474bc None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:19.441269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f7390-9a51-4554-80b0-60f52d9474bc None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:19.441269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f7390-9a51-4554-80b0-60f52d9474bc None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:19.442571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 662/1352] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:19.448346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42647-afe3-44db-ba8d-9d14b52a38df None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:19.449131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42647-afe3-44db-ba8d-9d14b52a38df None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:19.449583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42647-afe3-44db-ba8d-9d14b52a38df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:19.533727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bcf42647-afe3-44db-ba8d-9d14b52a38df None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:19.535664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bcf42647-afe3-44db-ba8d-9d14b52a38df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:19.613568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:19.654601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 691/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:15:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:21.091248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe8ca-18fb-4ad0-a0de-d3e3b73b075b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:21.091806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe8ca-18fb-4ad0-a0de-d3e3b73b075b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:21.091906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe8ca-18fb-4ad0-a0de-d3e3b73b075b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:21.093286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 663/1354] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:21.098311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910c199-7918-4a60-ac70-0258d05b5542 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:21.098721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910c199-7918-4a60-ac70-0258d05b5542 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:21.099060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910c199-7918-4a60-ac70-0258d05b5542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:21.175171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7910c199-7918-4a60-ac70-0258d05b5542 None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:21.176395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7910c199-7918-4a60-ac70-0258d05b5542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:21.280625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 692/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:15:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:24.606352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad67aa-a613-4beb-8deb-13760da54323 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:24.606874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad67aa-a613-4beb-8deb-13760da54323 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:24.606874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad67aa-a613-4beb-8deb-13760da54323 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:24.608592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 664/1356] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:24.614596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5410-4e10-4eb8-91d3-e9b12ef59ea7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:24.615056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5410-4e10-4eb8-91d3-e9b12ef59ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:24.615159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5410-4e10-4eb8-91d3-e9b12ef59ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:24.661912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:24.705990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-abee5410-4e10-4eb8-91d3-e9b12ef59ea7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:24.707201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-abee5410-4e10-4eb8-91d3-e9b12ef59ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:24.827625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 693/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:25.131599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64832a-b86a-4e5d-bb0a-a59321950bac None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:25.132504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64832a-b86a-4e5d-bb0a-a59321950bac None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:25.133079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64832a-b86a-4e5d-bb0a-a59321950bac None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:25.134656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 665/1358] 10.222.0.18 () {54 vars in 962 bytes} [Tue Sep 6 04:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:25.142015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec335d5-591d-42c3-b0b4-099caf451fac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:25.142402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec335d5-591d-42c3-b0b4-099caf451fac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:25.142751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec335d5-591d-42c3-b0b4-099caf451fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:25.232630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bec335d5-591d-42c3-b0b4-099caf451fac None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:25.233927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bec335d5-591d-42c3-b0b4-099caf451fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:25.289776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:25.362491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 694/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Sep 6 04:15:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:25.370352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64832a-b86a-4e5d-bb0a-a59321950bac None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:25.372004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cc64832a-b86a-4e5d-bb0a-a59321950bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:25.540578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64832a-b86a-4e5d-bb0a-a59321950bac None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:25.618949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:25.661082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86558a-b7a1-402d-953f-1349934cd435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:25.661685 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86558a-b7a1-402d-953f-1349934cd435 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:25.661960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86558a-b7a1-402d-953f-1349934cd435 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:25.662225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86558a-b7a1-402d-953f-1349934cd435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:25.664336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cf86558a-b7a1-402d-953f-1349934cd435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:25.755650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86558a-b7a1-402d-953f-1349934cd435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:25.757263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86558a-b7a1-402d-953f-1349934cd435 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:25.775266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 666/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:15:27.897798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152b8a-590a-4d19-9663-b77918dfe9a1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:27.898364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152b8a-590a-4d19-9663-b77918dfe9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:27.898638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152b8a-590a-4d19-9663-b77918dfe9a1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:27.900156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 695/1361] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:27.905617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb519a-f9c0-4d7f-81a6-9305b60c80c8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:27.906076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb519a-f9c0-4d7f-81a6-9305b60c80c8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:27.906182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb519a-f9c0-4d7f-81a6-9305b60c80c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:27.975703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0dbb519a-f9c0-4d7f-81a6-9305b60c80c8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:27.976922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0dbb519a-f9c0-4d7f-81a6-9305b60c80c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:28.017342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:28.088993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 667/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:28.382022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152b8a-590a-4d19-9663-b77918dfe9a1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:28.383794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1f152b8a-590a-4d19-9663-b77918dfe9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:28.552019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152b8a-590a-4d19-9663-b77918dfe9a1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:28.562335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:28.684617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b17b6-e0dd-40c7-a977-b7e5f97380a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:28.685242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b17b6-e0dd-40c7-a977-b7e5f97380a8 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:28.685517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b17b6-e0dd-40c7-a977-b7e5f97380a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:28.685922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b17b6-e0dd-40c7-a977-b7e5f97380a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:28.687610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fb2b17b6-e0dd-40c7-a977-b7e5f97380a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:28.780620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b17b6-e0dd-40c7-a977-b7e5f97380a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:28.782224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b17b6-e0dd-40c7-a977-b7e5f97380a8 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:28.800408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 696/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:31.025725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182f18-964b-4ceb-bcdd-a6e95ad03574 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:31.026233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182f18-964b-4ceb-bcdd-a6e95ad03574 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:31.026339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182f18-964b-4ceb-bcdd-a6e95ad03574 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:31.027651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 668/1364] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:31.033042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e717f-68d9-49f6-8fbc-ebe7aa4071ae None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:31.033436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e717f-68d9-49f6-8fbc-ebe7aa4071ae None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:31.033620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e717f-68d9-49f6-8fbc-ebe7aa4071ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:31.049861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:31.104193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-853e717f-68d9-49f6-8fbc-ebe7aa4071ae None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:31.105413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-853e717f-68d9-49f6-8fbc-ebe7aa4071ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:31.207490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 697/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:15:31.502535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6546d-bf07-4ea7-9685-2841ff36b408 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:31.503045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6546d-bf07-4ea7-9685-2841ff36b408 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:31.503545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6546d-bf07-4ea7-9685-2841ff36b408 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:31.505345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 669/1366] 10.222.0.18 () {54 vars in 962 bytes} [Tue Sep 6 04:15:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:31.512575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0de07-146b-45a1-9096-bd6add0763b7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:31.513113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0de07-146b-45a1-9096-bd6add0763b7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:31.513590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0de07-146b-45a1-9096-bd6add0763b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:31.596956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-21d0de07-146b-45a1-9096-bd6add0763b7 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:31.598468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-21d0de07-146b-45a1-9096-bd6add0763b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:31.752522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:31.845107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 698/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Sep 6 04:15:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:31.852830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6546d-bf07-4ea7-9685-2841ff36b408 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:31.854365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f3d6546d-bf07-4ea7-9685-2841ff36b408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:32.017579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6546d-bf07-4ea7-9685-2841ff36b408 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:32.039057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:32.140091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e62b7c-3c38-4a16-974f-582ba6fc32cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:32.140703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e62b7c-3c38-4a16-974f-582ba6fc32cb service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:32.140976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e62b7c-3c38-4a16-974f-582ba6fc32cb service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:32.141241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e62b7c-3c38-4a16-974f-582ba6fc32cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:32.142928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f3e62b7c-3c38-4a16-974f-582ba6fc32cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:32.238233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e62b7c-3c38-4a16-974f-582ba6fc32cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:32.239863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e62b7c-3c38-4a16-974f-582ba6fc32cb service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:32.261629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 670/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:32.803506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0947-982a-4e0f-a4c1-1350a888b6f7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:32.804047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0947-982a-4e0f-a4c1-1350a888b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:32.804047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0947-982a-4e0f-a4c1-1350a888b6f7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:32.805374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 699/1369] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:32.810488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad16a-0147-42cd-b0b8-91bdec939a32 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:32.810767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad16a-0147-42cd-b0b8-91bdec939a32 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:32.811035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad16a-0147-42cd-b0b8-91bdec939a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:32.844142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:32.881790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-341ad16a-0147-42cd-b0b8-91bdec939a32 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:32.882986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-341ad16a-0147-42cd-b0b8-91bdec939a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:32.995708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 671/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:33.583042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0e0f7-9ff0-4689-8e99-0aeae45da5a1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:33.583605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0e0f7-9ff0-4689-8e99-0aeae45da5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:33.584049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0e0f7-9ff0-4689-8e99-0aeae45da5a1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:33.585531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 700/1371] 10.222.0.18 () {54 vars in 964 bytes} [Tue Sep 6 04:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:33.590758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afda20c-fe79-434a-80ff-003f32e0a5ee None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:33.591188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afda20c-fe79-434a-80ff-003f32e0a5ee None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:33.591395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afda20c-fe79-434a-80ff-003f32e0a5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:33.671893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3afda20c-fe79-434a-80ff-003f32e0a5ee None None] MFA Rules not processed for user `fa181d21ba124c4ba2efd96ddecf5f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:33.673381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3afda20c-fe79-434a-80ff-003f32e0a5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:33.725896 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:33.760587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 672/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Sep 6 04:15:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:33.768391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0e0f7-9ff0-4689-8e99-0aeae45da5a1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:33.769922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-05c0e0f7-9ff0-4689-8e99-0aeae45da5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:33.886661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0e0f7-9ff0-4689-8e99-0aeae45da5a1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:33.931580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:33.971713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7c39f-f8d5-4290-8fdf-d3e2ceb4639e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:33.972395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7c39f-f8d5-4290-8fdf-d3e2ceb4639e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:33.972566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7c39f-f8d5-4290-8fdf-d3e2ceb4639e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:33.972880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7c39f-f8d5-4290-8fdf-d3e2ceb4639e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:33.975268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1dc7c39f-f8d5-4290-8fdf-d3e2ceb4639e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:34.110383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7c39f-f8d5-4290-8fdf-d3e2ceb4639e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:34.112028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7c39f-f8d5-4290-8fdf-d3e2ceb4639e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:34.131293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 701/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:34.304056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37c0be-df6e-403a-aa03-9d50c634ee9b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:34.304490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37c0be-df6e-403a-aa03-9d50c634ee9b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:34.304872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37c0be-df6e-403a-aa03-9d50c634ee9b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:34.306346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 673/1374] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:34.312374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2394003-a3b4-4d84-9fe3-0088bee5d40f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:34.312717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2394003-a3b4-4d84-9fe3-0088bee5d40f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:34.312997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2394003-a3b4-4d84-9fe3-0088bee5d40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:34.381398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b2394003-a3b4-4d84-9fe3-0088bee5d40f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:34.382515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b2394003-a3b4-4d84-9fe3-0088bee5d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:34.402876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:34.479963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 702/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:34.775274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37c0be-df6e-403a-aa03-9d50c634ee9b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:34.776909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6a37c0be-df6e-403a-aa03-9d50c634ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:34.922927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37c0be-df6e-403a-aa03-9d50c634ee9b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:34.974293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:35.039252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c642d-cc3c-4307-8fb0-9172258cce4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:35.039886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c642d-cc3c-4307-8fb0-9172258cce4e service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:35.040166 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c642d-cc3c-4307-8fb0-9172258cce4e service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:35.040437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c642d-cc3c-4307-8fb0-9172258cce4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:35.042031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-339c642d-cc3c-4307-8fb0-9172258cce4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:35.134696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c642d-cc3c-4307-8fb0-9172258cce4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:35.136337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c642d-cc3c-4307-8fb0-9172258cce4e service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:35.154181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 674/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:37.202417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b785c-c84e-47b3-b53b-3da9880ccc56 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:37.202923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b785c-c84e-47b3-b53b-3da9880ccc56 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:37.203045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b785c-c84e-47b3-b53b-3da9880ccc56 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:37.204346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 703/1377] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:37.211243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc5637-8fb1-4a3f-ac83-ceb5c5315158 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:37.211710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc5637-8fb1-4a3f-ac83-ceb5c5315158 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:37.211821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc5637-8fb1-4a3f-ac83-ceb5c5315158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:37.278375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-bdcc5637-8fb1-4a3f-ac83-ceb5c5315158 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:37.279519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-bdcc5637-8fb1-4a3f-ac83-ceb5c5315158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:37.286016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:37.375383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 675/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:37.667944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b785c-c84e-47b3-b53b-3da9880ccc56 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:37.669660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f43b785c-c84e-47b3-b53b-3da9880ccc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:37.841134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b785c-c84e-47b3-b53b-3da9880ccc56 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:37.844938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:37.959077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e01316-bb53-4500-a2f7-a24edcedebc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:37.959705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01316-bb53-4500-a2f7-a24edcedebc1 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:37.959980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01316-bb53-4500-a2f7-a24edcedebc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:37.960244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01316-bb53-4500-a2f7-a24edcedebc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:37.961813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f4e01316-bb53-4500-a2f7-a24edcedebc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:38.060664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e01316-bb53-4500-a2f7-a24edcedebc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:38.062341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e01316-bb53-4500-a2f7-a24edcedebc1 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:38.081882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 704/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:40.013642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b143-6894-411e-ad61-45fe7b38268b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:40.014167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b143-6894-411e-ad61-45fe7b38268b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:40.014167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b143-6894-411e-ad61-45fe7b38268b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:40.015731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 676/1380] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:40.020776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910609ea-80a4-431f-a8bd-a0771dc1b168 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:40.021817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910609ea-80a4-431f-a8bd-a0771dc1b168 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:40.021894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910609ea-80a4-431f-a8bd-a0771dc1b168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:40.033373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:40.091977 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-910609ea-80a4-431f-a8bd-a0771dc1b168 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:40.093183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-910609ea-80a4-431f-a8bd-a0771dc1b168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:40.195286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 705/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:15:40.483815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b143-6894-411e-ad61-45fe7b38268b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:40.485379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c0d2b143-6894-411e-ad61-45fe7b38268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:40.632578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:40.643724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b143-6894-411e-ad61-45fe7b38268b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:40.771670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9832e-bd69-4c29-970e-52558641b38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:40.772177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9832e-bd69-4c29-970e-52558641b38a service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:40.772571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9832e-bd69-4c29-970e-52558641b38a service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:40.772860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9832e-bd69-4c29-970e-52558641b38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:40.774445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-28c9832e-bd69-4c29-970e-52558641b38a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:40.873953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9832e-bd69-4c29-970e-52558641b38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:40.875945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9832e-bd69-4c29-970e-52558641b38a service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:40.886931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:40.897560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 677/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:42.847068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f95b-c2a2-4a18-a3e4-719f67c34f82 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:42.847797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f95b-c2a2-4a18-a3e4-719f67c34f82 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:42.847797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f95b-c2a2-4a18-a3e4-719f67c34f82 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:42.849527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 706/1383] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:42.854720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6484-33e3-4501-9d44-d107bdcbdaf6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:42.855155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6484-33e3-4501-9d44-d107bdcbdaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:42.855264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6484-33e3-4501-9d44-d107bdcbdaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:42.921545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-84aa6484-33e3-4501-9d44-d107bdcbdaf6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:42.922793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-84aa6484-33e3-4501-9d44-d107bdcbdaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:43.022024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 678/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:43.310077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f95b-c2a2-4a18-a3e4-719f67c34f82 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:43.312062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-65b3f95b-c2a2-4a18-a3e4-719f67c34f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:43.415439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:43.480159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f95b-c2a2-4a18-a3e4-719f67c34f82 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:43.595997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673734a-0809-4afb-ab8d-d402215e73fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:43.596458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673734a-0809-4afb-ab8d-d402215e73fb service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:43.596798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673734a-0809-4afb-ab8d-d402215e73fb service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:43.596989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673734a-0809-4afb-ab8d-d402215e73fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:43.598623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6673734a-0809-4afb-ab8d-d402215e73fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:43.650713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:43.691006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673734a-0809-4afb-ab8d-d402215e73fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:43.692694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673734a-0809-4afb-ab8d-d402215e73fb service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:43.711448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 707/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:45.828628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31784a01-e71f-4449-9c15-640796caacb3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:45.829142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31784a01-e71f-4449-9c15-640796caacb3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:45.829297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31784a01-e71f-4449-9c15-640796caacb3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:45.831367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 679/1386] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:45.838539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3e99-5884-4598-a124-a6c3f6bfff12 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:45.839156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3e99-5884-4598-a124-a6c3f6bfff12 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:45.839156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3e99-5884-4598-a124-a6c3f6bfff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:45.914332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-864b3e99-5884-4598-a124-a6c3f6bfff12 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:45.915625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-864b3e99-5884-4598-a124-a6c3f6bfff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:46.014894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 708/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:46.374366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31784a01-e71f-4449-9c15-640796caacb3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:46.376297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-31784a01-e71f-4449-9c15-640796caacb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:46.462667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:46.534331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31784a01-e71f-4449-9c15-640796caacb3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:46.668746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123c06e-0db5-4988-ba13-2f3900025613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:46.669479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c06e-0db5-4988-ba13-2f3900025613 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:46.669952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c06e-0db5-4988-ba13-2f3900025613 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:46.670295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c06e-0db5-4988-ba13-2f3900025613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:46.672350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6123c06e-0db5-4988-ba13-2f3900025613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:46.716612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:46.769206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123c06e-0db5-4988-ba13-2f3900025613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:46.771479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123c06e-0db5-4988-ba13-2f3900025613 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:46.789705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 680/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:48.746710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b98b58-35b7-48d3-8010-13540d318b52 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:48.747339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b98b58-35b7-48d3-8010-13540d318b52 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:48.747339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b98b58-35b7-48d3-8010-13540d318b52 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:48.748818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 709/1389] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:48.754206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a359f9-1515-4031-b135-98296b35aa51 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:48.754644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a359f9-1515-4031-b135-98296b35aa51 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:48.754907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a359f9-1515-4031-b135-98296b35aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:48.821289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a2a359f9-1515-4031-b135-98296b35aa51 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:48.822776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a2a359f9-1515-4031-b135-98296b35aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:48.923665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 681/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:49.070508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf20bd9-72ce-4882-bc67-34514cec935d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:49.070794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf20bd9-72ce-4882-bc67-34514cec935d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:49.071065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf20bd9-72ce-4882-bc67-34514cec935d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:49.072440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 710/1391] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:49.077530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532a06-cbc6-4db3-ba37-c884e4a8c67a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:49.077813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532a06-cbc6-4db3-ba37-c884e4a8c67a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:49.078087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532a06-cbc6-4db3-ba37-c884e4a8c67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:49.094028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:49.144237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-67532a06-cbc6-4db3-ba37-c884e4a8c67a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:49.145944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-67532a06-cbc6-4db3-ba37-c884e4a8c67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:49.214607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf20bd9-72ce-4882-bc67-34514cec935d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:49.216151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdf20bd9-72ce-4882-bc67-34514cec935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:49.244559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 682/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:49.247721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:49.363249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf20bd9-72ce-4882-bc67-34514cec935d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:49.464028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:49.476919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:49.477524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:49.477801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:49.478069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:49.479686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:49.544192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acf4cd-bb88-4a95-a6ad-aa8eb39972f4 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:49.544689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acf4cd-bb88-4a95-a6ad-aa8eb39972f4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:49.544970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acf4cd-bb88-4a95-a6ad-aa8eb39972f4 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:49.546476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 683/1393] 10.222.0.18 () {54 vars in 961 bytes} [Tue Sep 6 04:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:49.551109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c48d-3fbb-4194-a9fe-7b555327ed15 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:49.551411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c48d-3fbb-4194-a9fe-7b555327ed15 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:49.551719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c48d-3fbb-4194-a9fe-7b555327ed15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:49.574453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:49.576082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:49.594189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 711/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:15:49.633413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1462c48d-3fbb-4194-a9fe-7b555327ed15 None None] MFA Rules not processed for user `6b07846b067c4073b5701db6e9232d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:49.634648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1462c48d-3fbb-4194-a9fe-7b555327ed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:49.670484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:49.719300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 684/1395] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Sep 6 04:15:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:15:49.727395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:49.728716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:49.809150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dfba8-1ea8-4f24-bb74-a033482dad30 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:49.850094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:49.884494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539845a-7842-4721-a6b2-2bb9732d5050 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:49.885016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539845a-7842-4721-a6b2-2bb9732d5050 service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:49.885291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539845a-7842-4721-a6b2-2bb9732d5050 service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:49.885555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539845a-7842-4721-a6b2-2bb9732d5050 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:49.887136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d539845a-7842-4721-a6b2-2bb9732d5050 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:49.999334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539845a-7842-4721-a6b2-2bb9732d5050 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:50.001069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539845a-7842-4721-a6b2-2bb9732d5050 service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:50.019886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 712/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:50.767484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0571f-90b6-409e-a3a4-d0c44420fc04 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:50.767985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0571f-90b6-409e-a3a4-d0c44420fc04 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:50.768077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0571f-90b6-409e-a3a4-d0c44420fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:50.834430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-99c0571f-90b6-409e-a3a4-d0c44420fc04 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:50.835654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-99c0571f-90b6-409e-a3a4-d0c44420fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:50.932013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 685/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:15:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:50.981791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102c0ce-59c5-4e4c-ba66-43f9f624454e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:50.982306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102c0ce-59c5-4e4c-ba66-43f9f624454e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:50.982390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102c0ce-59c5-4e4c-ba66-43f9f624454e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:50.986537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 713/1398] 10.222.0.18 () {54 vars in 943 bytes} [Tue Sep 6 04:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:50.995167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a173-386a-4909-b482-1520095c924a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:50.998961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a173-386a-4909-b482-1520095c924a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:50.998961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a173-386a-4909-b482-1520095c924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:51.059996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:51.080446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-62d0a173-386a-4909-b482-1520095c924a None None] MFA Rules not processed for user `f7aaf3229ccf44718004798534537abc`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:51.081654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-62d0a173-386a-4909-b482-1520095c924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:51.187826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 686/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Tue Sep 6 04:15:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:51.198100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102c0ce-59c5-4e4c-ba66-43f9f624454e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:51.199822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5102c0ce-59c5-4e4c-ba66-43f9f624454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:51.285196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:51.346490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102c0ce-59c5-4e4c-ba66-43f9f624454e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:51.449524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:51.450070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:51.450342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:51.450607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:51.452243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:51.513141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:51.538273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaec1b-1fc1-454f-a7ca-100b53009c7d None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:51.538555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaec1b-1fc1-454f-a7ca-100b53009c7d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:51.538851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaec1b-1fc1-454f-a7ca-100b53009c7d None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:51.538972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:51.540271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 687/1400] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:15:51.541050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:51.545490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32223-0361-49e8-af11-6f949094497c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:51.545772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32223-0361-49e8-af11-6f949094497c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:51.546070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32223-0361-49e8-af11-6f949094497c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:51.549614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 714/1401] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:15:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:15:51.617093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-10f32223-0361-49e8-af11-6f949094497c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:51.618305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-10f32223-0361-49e8-af11-6f949094497c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:51.680286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:51.726206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 688/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:15:52.016277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:52.018015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:52.112868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9bbf2-7193-4697-aa84-d7841f6b72cb service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:52.231981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:52.250235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291ace8-87b2-4ac4-af29-c44085107e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:52.250235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ace8-87b2-4ac4-af29-c44085107e4f service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:52.250643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ace8-87b2-4ac4-af29-c44085107e4f service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:52.250779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ace8-87b2-4ac4-af29-c44085107e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:52.253065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6291ace8-87b2-4ac4-af29-c44085107e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:52.356349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291ace8-87b2-4ac4-af29-c44085107e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:52.358097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291ace8-87b2-4ac4-af29-c44085107e4f service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:52.377457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 715/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:15:54.337998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503562-ad98-42ea-85eb-bdbdc962a66f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:54.338574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503562-ad98-42ea-85eb-bdbdc962a66f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:54.338867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503562-ad98-42ea-85eb-bdbdc962a66f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:54.341364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 689/1404] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:54.347204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59e84-ae5d-40da-9543-062668733c7d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:54.347698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59e84-ae5d-40da-9543-062668733c7d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:54.347801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59e84-ae5d-40da-9543-062668733c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:54.421767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-afa59e84-ae5d-40da-9543-062668733c7d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:54.422989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-afa59e84-ae5d-40da-9543-062668733c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:54.486036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:54.528513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 716/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:54.824451 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32503562-ad98-42ea-85eb-bdbdc962a66f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:54.825973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-32503562-ad98-42ea-85eb-bdbdc962a66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:54.999012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32503562-ad98-42ea-85eb-bdbdc962a66f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:55.048173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:55.143777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c3229-840d-4739-a1ea-b10477872a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:55.143777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c3229-840d-4739-a1ea-b10477872a83 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:55.143777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c3229-840d-4739-a1ea-b10477872a83 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:55.143777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c3229-840d-4739-a1ea-b10477872a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:55.144234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-557c3229-840d-4739-a1ea-b10477872a83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:55.275867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c3229-840d-4739-a1ea-b10477872a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:55.277541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c3229-840d-4739-a1ea-b10477872a83 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:55.296934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 690/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:15:57.321350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba21cb-d291-4f60-88e6-29fb4d7768fc None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:57.321900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba21cb-d291-4f60-88e6-29fb4d7768fc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:57.321900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba21cb-d291-4f60-88e6-29fb4d7768fc None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:57.323153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 717/1407] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:15:57.328407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170854-28dd-4f09-8788-6f2aa7a70ad9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:57.328858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170854-28dd-4f09-8788-6f2aa7a70ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:57.328950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170854-28dd-4f09-8788-6f2aa7a70ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:57.393647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:57.400959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-18170854-28dd-4f09-8788-6f2aa7a70ad9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:15:57.402179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-18170854-28dd-4f09-8788-6f2aa7a70ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:57.522161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 691/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:15:57.820565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba21cb-d291-4f60-88e6-29fb4d7768fc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:15:57.822096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5cba21cb-d291-4f60-88e6-29fb4d7768fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:57.990206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba21cb-d291-4f60-88e6-29fb4d7768fc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:15:58.043696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:15:58.121464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585bf4c-b3e4-4dc6-bf1c-5673fd14b405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:15:58.122197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585bf4c-b3e4-4dc6-bf1c-5673fd14b405 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:15:58.122325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585bf4c-b3e4-4dc6-bf1c-5673fd14b405 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:15:58.122559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585bf4c-b3e4-4dc6-bf1c-5673fd14b405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:15:58.124632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8585bf4c-b3e4-4dc6-bf1c-5673fd14b405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:15:58.227661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585bf4c-b3e4-4dc6-bf1c-5673fd14b405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:15:58.229389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585bf4c-b3e4-4dc6-bf1c-5673fd14b405 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:15:58.248499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 718/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:07.515828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=44 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:08.246246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=77 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:13.610949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d1ac7-79e0-43c2-895e-392b2d579156 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:13.611566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d1ac7-79e0-43c2-895e-392b2d579156 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:13.611566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d1ac7-79e0-43c2-895e-392b2d579156 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:13.613490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 692/1410] 10.222.0.18 () {54 vars in 918 bytes} [Tue Sep 6 04:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:13.618642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4d88-b45b-413e-a02c-5d42b6fdd22b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:13.619073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4d88-b45b-413e-a02c-5d42b6fdd22b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:13.619170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4d88-b45b-413e-a02c-5d42b6fdd22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:13.693873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8c7c4d88-b45b-413e-a02c-5d42b6fdd22b None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:13.695073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8c7c4d88-b45b-413e-a02c-5d42b6fdd22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:13.798902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 719/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Sep 6 04:16:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:13.813484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13220f-a929-4587-80c3-caabd9ecbbb9 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:13.813765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13220f-a929-4587-80c3-caabd9ecbbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:13.814033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13220f-a929-4587-80c3-caabd9ecbbb9 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:13.815435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 693/1412] 10.222.0.18 () {54 vars in 918 bytes} [Tue Sep 6 04:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:13.820170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae1e7-739b-4eb4-ba13-0f57b61242b4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:13.820449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae1e7-739b-4eb4-ba13-0f57b61242b4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:13.820714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae1e7-739b-4eb4-ba13-0f57b61242b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:13.892221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:13.895604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-72dae1e7-739b-4eb4-ba13-0f57b61242b4 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:13.901456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-72dae1e7-739b-4eb4-ba13-0f57b61242b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:14.017047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 720/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Sep 6 04:16:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:16.365238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb5777-803d-4373-ba92-03d502054f69 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:16.365760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb5777-803d-4373-ba92-03d502054f69 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:16.365760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb5777-803d-4373-ba92-03d502054f69 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:16.367121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:16.372311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff4dc2-f3e9-4486-b62f-f641eb98914a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:16.372721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff4dc2-f3e9-4486-b62f-f641eb98914a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:16.372853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff4dc2-f3e9-4486-b62f-f641eb98914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:16.441607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-93ff4dc2-f3e9-4486-b62f-f641eb98914a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:16.443017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-93ff4dc2-f3e9-4486-b62f-f641eb98914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:16.497851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:16.539580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:16.823837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb5777-803d-4373-ba92-03d502054f69 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:16.825374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b9bb5777-803d-4373-ba92-03d502054f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:16.967971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb5777-803d-4373-ba92-03d502054f69 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:17.039607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:17.079577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f996cd-d8bd-4a43-aec8-0c3404f51e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:17.080172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f996cd-d8bd-4a43-aec8-0c3404f51e8d service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:17.080448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f996cd-d8bd-4a43-aec8-0c3404f51e8d service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:17.080716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f996cd-d8bd-4a43-aec8-0c3404f51e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:17.082330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f5f996cd-d8bd-4a43-aec8-0c3404f51e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:17.169327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f996cd-d8bd-4a43-aec8-0c3404f51e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:17.170941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f996cd-d8bd-4a43-aec8-0c3404f51e8d service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:17.189306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 695/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:18.071485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb666f-8da2-41f2-b751-4033888f8fc7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:18.072003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb666f-8da2-41f2-b751-4033888f8fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:18.072109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb666f-8da2-41f2-b751-4033888f8fc7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:18.073382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:18.078103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279c8a-4236-4e9c-8798-19a5467fd22c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:18.078510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279c8a-4236-4e9c-8798-19a5467fd22c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:18.078644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279c8a-4236-4e9c-8798-19a5467fd22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:18.161536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-18279c8a-4236-4e9c-8798-19a5467fd22c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:18.162743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-18279c8a-4236-4e9c-8798-19a5467fd22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:18.189491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:18.260023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:18.411079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb666f-8da2-41f2-b751-4033888f8fc7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:18.412647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cbcb666f-8da2-41f2-b751-4033888f8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:18.556103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb666f-8da2-41f2-b751-4033888f8fc7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:18.595184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:18.668101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99071725-da4e-41dc-aedf-4a55cf969b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:18.668710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071725-da4e-41dc-aedf-4a55cf969b72 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:18.668987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071725-da4e-41dc-aedf-4a55cf969b72 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:18.669257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071725-da4e-41dc-aedf-4a55cf969b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:18.670859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-99071725-da4e-41dc-aedf-4a55cf969b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:18.758233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99071725-da4e-41dc-aedf-4a55cf969b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:18.759864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99071725-da4e-41dc-aedf-4a55cf969b72 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:18.777693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 723/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:19.657061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097163-5e69-417d-9224-b226dbbcfca3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:19.657632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097163-5e69-417d-9224-b226dbbcfca3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:19.657632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097163-5e69-417d-9224-b226dbbcfca3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:19.659520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:19.664508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60074-46ca-465f-b9f9-7e7ad0587e76 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:19.664955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60074-46ca-465f-b9f9-7e7ad0587e76 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:19.665072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60074-46ca-465f-b9f9-7e7ad0587e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:19.719153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:19.742194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-58b60074-46ca-465f-b9f9-7e7ad0587e76 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:19.743418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-58b60074-46ca-465f-b9f9-7e7ad0587e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:19.842995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:19.992988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097163-5e69-417d-9224-b226dbbcfca3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:19.994769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6e097163-5e69-417d-9224-b226dbbcfca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:20.137135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097163-5e69-417d-9224-b226dbbcfca3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:20.149632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:20.249982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de054e1d-ebee-4c2a-bb00-c76af62fb61c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:20.250485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de054e1d-ebee-4c2a-bb00-c76af62fb61c service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:20.250757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de054e1d-ebee-4c2a-bb00-c76af62fb61c service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:20.251023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de054e1d-ebee-4c2a-bb00-c76af62fb61c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:20.253219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-de054e1d-ebee-4c2a-bb00-c76af62fb61c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:20.340093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de054e1d-ebee-4c2a-bb00-c76af62fb61c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:20.341688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de054e1d-ebee-4c2a-bb00-c76af62fb61c service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:20.359320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 698/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:21.217097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5773ac-730c-4b13-848e-5a516d1af3fd None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:21.217670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5773ac-730c-4b13-848e-5a516d1af3fd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:21.217670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5773ac-730c-4b13-848e-5a516d1af3fd None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:21.219087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:21.224636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0989f-26cb-4b00-bca3-51c060407d99 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:21.225036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0989f-26cb-4b00-bca3-51c060407d99 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:21.225184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0989f-26cb-4b00-bca3-51c060407d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:21.245146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:21.301151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-60e0989f-26cb-4b00-bca3-51c060407d99 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:21.302273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-60e0989f-26cb-4b00-bca3-51c060407d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:21.397590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:21.551539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5773ac-730c-4b13-848e-5a516d1af3fd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:21.553014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-be5773ac-730c-4b13-848e-5a516d1af3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:21.662489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:21.699699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5773ac-730c-4b13-848e-5a516d1af3fd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:21.813232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaefa3-7b21-4072-b834-fb41f2d35228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:21.813739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaefa3-7b21-4072-b834-fb41f2d35228 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:21.814011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaefa3-7b21-4072-b834-fb41f2d35228 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:21.814275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaefa3-7b21-4072-b834-fb41f2d35228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:21.816425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-23aaefa3-7b21-4072-b834-fb41f2d35228 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:21.889966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:21.903557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaefa3-7b21-4072-b834-fb41f2d35228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:21.905137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaefa3-7b21-4072-b834-fb41f2d35228 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:21.922420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 726/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:22.777815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3e2a-5193-41ab-a94b-965c2fd832ef None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:22.778338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3e2a-5193-41ab-a94b-965c2fd832ef None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:22.778338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3e2a-5193-41ab-a94b-965c2fd832ef None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:22.779693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:16:22.785130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb948-8cd4-49e9-bcd1-6960540ab285 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:22.785527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb948-8cd4-49e9-bcd1-6960540ab285 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:22.785674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb948-8cd4-49e9-bcd1-6960540ab285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:22.860888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a6bcb948-8cd4-49e9-bcd1-6960540ab285 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:22.862111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a6bcb948-8cd4-49e9-bcd1-6960540ab285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:22.955512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:23.107097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c3e2a-5193-41ab-a94b-965c2fd832ef None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:23.108583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5e6c3e2a-5193-41ab-a94b-965c2fd832ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:23.190771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:23.251247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c3e2a-5193-41ab-a94b-965c2fd832ef None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:23.361365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223216-1fa0-47c8-8942-2b216ccb881d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:23.361902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223216-1fa0-47c8-8942-2b216ccb881d service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:23.362182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223216-1fa0-47c8-8942-2b216ccb881d service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:23.362489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223216-1fa0-47c8-8942-2b216ccb881d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:23.364176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9a223216-1fa0-47c8-8942-2b216ccb881d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:23.411813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:23.452908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223216-1fa0-47c8-8942-2b216ccb881d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:23.454527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223216-1fa0-47c8-8942-2b216ccb881d service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:23.472777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 701/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:24.268116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf3034-2207-457d-850d-4287ccfdabd3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:24.268638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf3034-2207-457d-850d-4287ccfdabd3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:24.268751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf3034-2207-457d-850d-4287ccfdabd3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:24.270057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:24.274935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8febdf-846d-4795-8e79-0ece806ae33a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:24.275411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8febdf-846d-4795-8e79-0ece806ae33a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:24.275510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8febdf-846d-4795-8e79-0ece806ae33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:24.352031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-cf8febdf-846d-4795-8e79-0ece806ae33a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:24.353222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cf8febdf-846d-4795-8e79-0ece806ae33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:24.566984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:24.718953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf3034-2207-457d-850d-4287ccfdabd3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:24.720506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-55bf3034-2207-457d-850d-4287ccfdabd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:24.769153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:24.864961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf3034-2207-457d-850d-4287ccfdabd3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:24.975026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6f368-28b3-4fb7-9655-d658d66a10a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:24.975654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f368-28b3-4fb7-9655-d658d66a10a6 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:24.975931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f368-28b3-4fb7-9655-d658d66a10a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:24.976199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f368-28b3-4fb7-9655-d658d66a10a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:24.977782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-88d6f368-28b3-4fb7-9655-d658d66a10a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:24.986518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:25.068631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6f368-28b3-4fb7-9655-d658d66a10a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:25.070222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6f368-28b3-4fb7-9655-d658d66a10a6 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:25.087793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 729/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:25.888474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1770825-52d7-42bf-a254-5f840a345bac None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:25.888923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1770825-52d7-42bf-a254-5f840a345bac None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:25.889018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1770825-52d7-42bf-a254-5f840a345bac None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:25.890386 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:25.895626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2d51-8cce-49ed-b35d-5d4ebb2d2307 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:25.896080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2d51-8cce-49ed-b35d-5d4ebb2d2307 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:25.896171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2d51-8cce-49ed-b35d-5d4ebb2d2307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:25.971774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c48d2d51-8cce-49ed-b35d-5d4ebb2d2307 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:25.972965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c48d2d51-8cce-49ed-b35d-5d4ebb2d2307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:26.042548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:26.071988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:26.218386 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1770825-52d7-42bf-a254-5f840a345bac None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:26.219916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f1770825-52d7-42bf-a254-5f840a345bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:26.238141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:26.365912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1770825-52d7-42bf-a254-5f840a345bac None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:26.449018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:26.475325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa740f-e7f1-4d1a-ab02-167ea36cd2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:26.475885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa740f-e7f1-4d1a-ab02-167ea36cd2d8 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:26.476155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa740f-e7f1-4d1a-ab02-167ea36cd2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:26.476418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa740f-e7f1-4d1a-ab02-167ea36cd2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:26.477978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ffaa740f-e7f1-4d1a-ab02-167ea36cd2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:26.563233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa740f-e7f1-4d1a-ab02-167ea36cd2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:26.564832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa740f-e7f1-4d1a-ab02-167ea36cd2d8 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:26.582585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 704/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:27.389970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189eefb-ff5b-4697-b177-373f89114059 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:27.390521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189eefb-ff5b-4697-b177-373f89114059 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:27.390521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189eefb-ff5b-4697-b177-373f89114059 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:27.391833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:27.396628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de05e65-042f-4a22-93c0-f9ce4019c178 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:27.397074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de05e65-042f-4a22-93c0-f9ce4019c178 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:27.397178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de05e65-042f-4a22-93c0-f9ce4019c178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:27.472508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8de05e65-042f-4a22-93c0-f9ce4019c178 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:27.473700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8de05e65-042f-4a22-93c0-f9ce4019c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:27.514211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:27.569282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:27.715752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189eefb-ff5b-4697-b177-373f89114059 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:27.717281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4189eefb-ff5b-4697-b177-373f89114059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:27.868043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189eefb-ff5b-4697-b177-373f89114059 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:27.920586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:27.979357 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4643431-c51b-447a-9457-c7258c2bb7f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:27.979924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643431-c51b-447a-9457-c7258c2bb7f8 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:27.980202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643431-c51b-447a-9457-c7258c2bb7f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:27.980474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643431-c51b-447a-9457-c7258c2bb7f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:27.982070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f4643431-c51b-447a-9457-c7258c2bb7f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:28.071631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643431-c51b-447a-9457-c7258c2bb7f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:28.073232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643431-c51b-447a-9457-c7258c2bb7f8 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:28.091146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 732/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:28.891699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74933-8feb-47b5-b258-2e69def99d0f None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:28.892226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74933-8feb-47b5-b258-2e69def99d0f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:28.892226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74933-8feb-47b5-b258-2e69def99d0f None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:28.893515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:28.898477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847d5f-cb7b-442e-9190-fdf26f6f971d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:28.898927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847d5f-cb7b-442e-9190-fdf26f6f971d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:28.899061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847d5f-cb7b-442e-9190-fdf26f6f971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:28.973476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ba847d5f-cb7b-442e-9190-fdf26f6f971d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:28.974675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ba847d5f-cb7b-442e-9190-fdf26f6f971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:28.976706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:29.072265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:29.222375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74933-8feb-47b5-b258-2e69def99d0f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:29.223929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-55b74933-8feb-47b5-b258-2e69def99d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:29.369807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74933-8feb-47b5-b258-2e69def99d0f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:29.395659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:29.480111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87b0b0-e301-4b6f-a094-1e949c19056e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:29.480629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87b0b0-e301-4b6f-a094-1e949c19056e service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:29.480900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87b0b0-e301-4b6f-a094-1e949c19056e service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:29.481165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87b0b0-e301-4b6f-a094-1e949c19056e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:29.482725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4c87b0b0-e301-4b6f-a094-1e949c19056e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:29.568471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87b0b0-e301-4b6f-a094-1e949c19056e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:29.570035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87b0b0-e301-4b6f-a094-1e949c19056e service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:29.587736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 707/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:31.428855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519a87-e1f2-4f6e-b523-36b211f23a94 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:31.429412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519a87-e1f2-4f6e-b523-36b211f23a94 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:31.429412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519a87-e1f2-4f6e-b523-36b211f23a94 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:31.430667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:31.435968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d219-595d-4f5e-9ac5-71e93e46b145 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:31.436363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d219-595d-4f5e-9ac5-71e93e46b145 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:31.436515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d219-595d-4f5e-9ac5-71e93e46b145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:31.477195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:31.503117 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-67d6d219-595d-4f5e-9ac5-71e93e46b145 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:31.504361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-67d6d219-595d-4f5e-9ac5-71e93e46b145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:31.599625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:31.895443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75519a87-e1f2-4f6e-b523-36b211f23a94 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:31.896972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-75519a87-e1f2-4f6e-b523-36b211f23a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:31.998179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75519a87-e1f2-4f6e-b523-36b211f23a94 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:32.030265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:32.071266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd13d2c-ca49-4731-a5fa-d400f9c3daad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:32.071891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd13d2c-ca49-4731-a5fa-d400f9c3daad service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:32.072159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd13d2c-ca49-4731-a5fa-d400f9c3daad service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:32.072423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd13d2c-ca49-4731-a5fa-d400f9c3daad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:32.073993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6bd13d2c-ca49-4731-a5fa-d400f9c3daad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:32.183635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd13d2c-ca49-4731-a5fa-d400f9c3daad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:32.185056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd13d2c-ca49-4731-a5fa-d400f9c3daad service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:32.204791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 735/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:34.234972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef673-1802-4f14-930c-ed121d8a9f3e None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:34.235555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef673-1802-4f14-930c-ed121d8a9f3e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:34.235555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef673-1802-4f14-930c-ed121d8a9f3e None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:34.236966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:34.242352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de40f-27d7-45bb-bea4-72c24fd01fc1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:34.242769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de40f-27d7-45bb-bea4-72c24fd01fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:34.242923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de40f-27d7-45bb-bea4-72c24fd01fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:34.312713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c94de40f-27d7-45bb-bea4-72c24fd01fc1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:34.313851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c94de40f-27d7-45bb-bea4-72c24fd01fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:34.326337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:34.413533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:34.697243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef673-1802-4f14-930c-ed121d8a9f3e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:34.698801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-743ef673-1802-4f14-930c-ed121d8a9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:34.799046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef673-1802-4f14-930c-ed121d8a9f3e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:34.811324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:34.885868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115e1f-4174-4c5f-a95f-c888cdc82c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:34.886466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115e1f-4174-4c5f-a95f-c888cdc82c94 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:34.886738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115e1f-4174-4c5f-a95f-c888cdc82c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:34.887000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115e1f-4174-4c5f-a95f-c888cdc82c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:34.888625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-24115e1f-4174-4c5f-a95f-c888cdc82c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:34.994601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115e1f-4174-4c5f-a95f-c888cdc82c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:34.996009 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115e1f-4174-4c5f-a95f-c888cdc82c94 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:35.014951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 710/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:37.253460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf0c4-bfdd-4b69-9707-73f138b2c52f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:37.253984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf0c4-bfdd-4b69-9707-73f138b2c52f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:37.253984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf0c4-bfdd-4b69-9707-73f138b2c52f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:37.255285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:37.260653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b7673-653a-4aad-917f-5180868758f6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:37.261035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b7673-653a-4aad-917f-5180868758f6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:37.261199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b7673-653a-4aad-917f-5180868758f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:37.308339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:37.325944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-728b7673-653a-4aad-917f-5180868758f6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:37.327145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-728b7673-653a-4aad-917f-5180868758f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:37.423005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:37.710429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcf0c4-bfdd-4b69-9707-73f138b2c52f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:37.712011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9adcf0c4-bfdd-4b69-9707-73f138b2c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:37.819687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcf0c4-bfdd-4b69-9707-73f138b2c52f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:37.858367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:37.893521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff412f5d-a0f3-44ba-a161-22ed972ccc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:37.894121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412f5d-a0f3-44ba-a161-22ed972ccc4c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:37.894398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412f5d-a0f3-44ba-a161-22ed972ccc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:37.894671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412f5d-a0f3-44ba-a161-22ed972ccc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:37.896301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff412f5d-a0f3-44ba-a161-22ed972ccc4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:38.006151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff412f5d-a0f3-44ba-a161-22ed972ccc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:38.007631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff412f5d-a0f3-44ba-a161-22ed972ccc4c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:38.025641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 738/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:40.122111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e33c6-0f35-4b37-a4e3-018c3e016837 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:40.122640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e33c6-0f35-4b37-a4e3-018c3e016837 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:40.122640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e33c6-0f35-4b37-a4e3-018c3e016837 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:40.124334 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:40.129760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5b78-7dd4-455b-bb55-5b158576b9a2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:40.130180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5b78-7dd4-455b-bb55-5b158576b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:40.130292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5b78-7dd4-455b-bb55-5b158576b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:40.200243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-004a5b78-7dd4-455b-bb55-5b158576b9a2 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:40.201444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-004a5b78-7dd4-455b-bb55-5b158576b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:40.222242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:40.296984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:40.585766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e33c6-0f35-4b37-a4e3-018c3e016837 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:40.587274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-560e33c6-0f35-4b37-a4e3-018c3e016837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:40.687441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e33c6-0f35-4b37-a4e3-018c3e016837 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:40.709186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:40.763004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633036-9ce3-437b-8b6c-bc56342e92dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:40.763636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633036-9ce3-437b-8b6c-bc56342e92dd service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:40.763910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633036-9ce3-437b-8b6c-bc56342e92dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:40.764178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633036-9ce3-437b-8b6c-bc56342e92dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:40.765758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5e633036-9ce3-437b-8b6c-bc56342e92dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:40.870775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633036-9ce3-437b-8b6c-bc56342e92dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:40.872170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633036-9ce3-437b-8b6c-bc56342e92dd service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:40.891022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 713/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:42.870828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dd290-9a50-46c6-a2b2-53eb3f84fdc4 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:42.871428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dd290-9a50-46c6-a2b2-53eb3f84fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:42.871428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dd290-9a50-46c6-a2b2-53eb3f84fdc4 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:42.872725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:42.878157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5585d-57d2-437c-a4fb-b6c6a3e58ec4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:42.878574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5585d-57d2-437c-a4fb-b6c6a3e58ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:42.878695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5585d-57d2-437c-a4fb-b6c6a3e58ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:42.941867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:42.944741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-fdf5585d-57d2-437c-a4fb-b6c6a3e58ec4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:42.946498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fdf5585d-57d2-437c-a4fb-b6c6a3e58ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:43.043526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:16:43.329852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dd290-9a50-46c6-a2b2-53eb3f84fdc4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:43.331960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7e7dd290-9a50-46c6-a2b2-53eb3f84fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:43.434186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dd290-9a50-46c6-a2b2-53eb3f84fdc4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:43.482351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:43.507398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e722de4-3593-4721-ad2a-322489e19c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:43.508010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e722de4-3593-4721-ad2a-322489e19c83 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:43.508291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e722de4-3593-4721-ad2a-322489e19c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:43.508563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e722de4-3593-4721-ad2a-322489e19c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:43.510151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6e722de4-3593-4721-ad2a-322489e19c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:43.616164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e722de4-3593-4721-ad2a-322489e19c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:43.617521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e722de4-3593-4721-ad2a-322489e19c83 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:43.636180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 741/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:45.611357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766e48-0509-46c5-829a-0883bf37eabe None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:45.611955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766e48-0509-46c5-829a-0883bf37eabe None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:45.611955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766e48-0509-46c5-829a-0883bf37eabe None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:45.613338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:45.618468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d620-cde8-4320-b2a8-86fbad4f5209 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:45.618880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d620-cde8-4320-b2a8-86fbad4f5209 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:45.619012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d620-cde8-4320-b2a8-86fbad4f5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:45.684982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5154d620-cde8-4320-b2a8-86fbad4f5209 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:45.686188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5154d620-cde8-4320-b2a8-86fbad4f5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:45.715291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:45.782491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:46.067929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4766e48-0509-46c5-829a-0883bf37eabe None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:46.069464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a4766e48-0509-46c5-829a-0883bf37eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:46.170052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4766e48-0509-46c5-829a-0883bf37eabe None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:46.198189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:46.242403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fc68d-f093-4e5f-9013-ff31bc349be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:46.242996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fc68d-f093-4e5f-9013-ff31bc349be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:46.243268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fc68d-f093-4e5f-9013-ff31bc349be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:46.243563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fc68d-f093-4e5f-9013-ff31bc349be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:46.245154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f45fc68d-f093-4e5f-9013-ff31bc349be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:46.350864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fc68d-f093-4e5f-9013-ff31bc349be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:46.352369 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fc68d-f093-4e5f-9013-ff31bc349be8 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:46.372498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 716/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:48.306706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2007ff-93c5-4c9f-ab3a-ec5ce4c7f569 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:48.307254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2007ff-93c5-4c9f-ab3a-ec5ce4c7f569 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:48.307254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2007ff-93c5-4c9f-ab3a-ec5ce4c7f569 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:48.308539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:48.313831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75767-21b5-489c-aa93-15ca93b84ebe None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:48.314256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75767-21b5-489c-aa93-15ca93b84ebe None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:48.314395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75767-21b5-489c-aa93-15ca93b84ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:48.380581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3ca75767-21b5-489c-aa93-15ca93b84ebe None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:48.381783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3ca75767-21b5-489c-aa93-15ca93b84ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:48.389944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:48.479044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:16:48.760883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2007ff-93c5-4c9f-ab3a-ec5ce4c7f569 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:48.762408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2c2007ff-93c5-4c9f-ab3a-ec5ce4c7f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:48.867229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2007ff-93c5-4c9f-ab3a-ec5ce4c7f569 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:48.921759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:48.940445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdde1c-78b0-499a-af1a-23dbe9a7c0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:48.941045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdde1c-78b0-499a-af1a-23dbe9a7c0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:48.941320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdde1c-78b0-499a-af1a-23dbe9a7c0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:48.941588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdde1c-78b0-499a-af1a-23dbe9a7c0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:48.943161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-67cdde1c-78b0-499a-af1a-23dbe9a7c0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:49.050961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdde1c-78b0-499a-af1a-23dbe9a7c0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:49.052348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdde1c-78b0-499a-af1a-23dbe9a7c0f2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:49.070380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 744/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:50.996525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971aac6-6763-477b-b9fe-f90da3da5128 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:50.997050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971aac6-6763-477b-b9fe-f90da3da5128 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:50.997050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971aac6-6763-477b-b9fe-f90da3da5128 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:50.999079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:51.004643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b14ab-e180-46b7-adc1-30bc1a94a64f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:51.005037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b14ab-e180-46b7-adc1-30bc1a94a64f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:51.005191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b14ab-e180-46b7-adc1-30bc1a94a64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:51.069556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ac1b14ab-e180-46b7-adc1-30bc1a94a64f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:51.070755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ac1b14ab-e180-46b7-adc1-30bc1a94a64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:51.109573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:51.171741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:51.455076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971aac6-6763-477b-b9fe-f90da3da5128 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:51.456701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8971aac6-6763-477b-b9fe-f90da3da5128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:51.558169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971aac6-6763-477b-b9fe-f90da3da5128 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:51.594684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:51.630976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6ed7d-a3ad-4b13-94e2-73cfd044e351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:51.631601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6ed7d-a3ad-4b13-94e2-73cfd044e351 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:51.631874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6ed7d-a3ad-4b13-94e2-73cfd044e351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:51.632137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6ed7d-a3ad-4b13-94e2-73cfd044e351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:51.633696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b4d6ed7d-a3ad-4b13-94e2-73cfd044e351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:51.739562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6ed7d-a3ad-4b13-94e2-73cfd044e351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:51.740917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6ed7d-a3ad-4b13-94e2-73cfd044e351 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:51.759183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 719/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:53.732734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2726c38-7adc-4e73-a7c3-e0078a5adc2c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:53.733338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2726c38-7adc-4e73-a7c3-e0078a5adc2c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:53.733338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2726c38-7adc-4e73-a7c3-e0078a5adc2c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:53.734609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:53.740298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288667-32a3-4f3b-85dd-e60600225c22 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:53.740763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288667-32a3-4f3b-85dd-e60600225c22 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:53.740870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288667-32a3-4f3b-85dd-e60600225c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:53.805757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3f288667-32a3-4f3b-85dd-e60600225c22 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:53.806969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3f288667-32a3-4f3b-85dd-e60600225c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:53.825366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:53.901912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:54.185022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2726c38-7adc-4e73-a7c3-e0078a5adc2c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:54.186543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a2726c38-7adc-4e73-a7c3-e0078a5adc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:54.287624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2726c38-7adc-4e73-a7c3-e0078a5adc2c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:54.353467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:54.360620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d7a60-7288-4a7b-8a5a-9ab63369a22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:54.361271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7a60-7288-4a7b-8a5a-9ab63369a22c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:54.361553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7a60-7288-4a7b-8a5a-9ab63369a22c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:54.361826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7a60-7288-4a7b-8a5a-9ab63369a22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:54.363489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-279d7a60-7288-4a7b-8a5a-9ab63369a22c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:54.477300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d7a60-7288-4a7b-8a5a-9ab63369a22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:54.478727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d7a60-7288-4a7b-8a5a-9ab63369a22c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:54.496871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 747/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:16:56.429842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf569-4bc0-4a63-a308-ceeb1f76e09c None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:56.430381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf569-4bc0-4a63-a308-ceeb1f76e09c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:56.430381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf569-4bc0-4a63-a308-ceeb1f76e09c None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:56.431928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:16:56.437304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6f3e7-8d22-4561-ba35-6dfeea5e346d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:56.437724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6f3e7-8d22-4561-ba35-6dfeea5e346d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:56.437845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6f3e7-8d22-4561-ba35-6dfeea5e346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:56.503483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-33b6f3e7-8d22-4561-ba35-6dfeea5e346d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:16:56.504683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-33b6f3e7-8d22-4561-ba35-6dfeea5e346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:56.553023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:56.601160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:16:56.882042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cf569-4bc0-4a63-a308-ceeb1f76e09c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:16:56.883599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-be4cf569-4bc0-4a63-a308-ceeb1f76e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:56.984128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cf569-4bc0-4a63-a308-ceeb1f76e09c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:16:57.030697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:16:57.057347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f5163-b418-4004-acc0-02f61cee740d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:16:57.057944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f5163-b418-4004-acc0-02f61cee740d service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:16:57.058219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f5163-b418-4004-acc0-02f61cee740d service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:16:57.058484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f5163-b418-4004-acc0-02f61cee740d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:16:57.060097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-871f5163-b418-4004-acc0-02f61cee740d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:16:57.165102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f5163-b418-4004-acc0-02f61cee740d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:16:57.166457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f5163-b418-4004-acc0-02f61cee740d service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:16:57.184972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 722/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:17:06.599324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=22 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:07.182728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=66 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:16.578513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053dd1-d63e-4cfa-8bfa-ce9d1474180b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:16.579064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053dd1-d63e-4cfa-8bfa-ce9d1474180b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:16.579064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053dd1-d63e-4cfa-8bfa-ce9d1474180b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:16.581235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 749/1471] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:16.587687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f75e7-37e9-471c-956a-b713614021c4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:16.588134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f75e7-37e9-471c-956a-b713614021c4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:16.588236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f75e7-37e9-471c-956a-b713614021c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:16.653075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d46f75e7-37e9-471c-956a-b713614021c4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:16.654297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d46f75e7-37e9-471c-956a-b713614021c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:16.750677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 723/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:17:17.047042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa3a4-f3ee-411a-99bb-51790d1d9fe8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:17.047321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa3a4-f3ee-411a-99bb-51790d1d9fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:17.047613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa3a4-f3ee-411a-99bb-51790d1d9fe8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:17.049461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 750/1473] 10.222.0.18 () {54 vars in 961 bytes} [Tue Sep 6 04:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:17.054258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7ba4-0fec-4b29-9a97-d71f01ab7e1b None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:17.054543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7ba4-0fec-4b29-9a97-d71f01ab7e1b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:17.054816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7ba4-0fec-4b29-9a97-d71f01ab7e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:17.130677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8d0a7ba4-0fec-4b29-9a97-d71f01ab7e1b None None] MFA Rules not processed for user `6b07846b067c4073b5701db6e9232d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:17.131906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8d0a7ba4-0fec-4b29-9a97-d71f01ab7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:17.151817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:17.206490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 724/1474] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Sep 6 04:17:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:17:17.213915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fa3a4-f3ee-411a-99bb-51790d1d9fe8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:17:17.215426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-418fa3a4-f3ee-411a-99bb-51790d1d9fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:17.316774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fa3a4-f3ee-411a-99bb-51790d1d9fe8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:17:17.388920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5807e91-2286-4e73-9788-54667ddc2ce7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:17:17.389521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807e91-2286-4e73-9788-54667ddc2ce7 service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:17.389795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807e91-2286-4e73-9788-54667ddc2ce7 service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:17.390080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807e91-2286-4e73-9788-54667ddc2ce7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:17.391672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5807e91-2286-4e73-9788-54667ddc2ce7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:17.444384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:17.499235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5807e91-2286-4e73-9788-54667ddc2ce7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:17:17.500684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5807e91-2286-4e73-9788-54667ddc2ce7 service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:17:17.518563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 751/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:17:19.494149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52381a4-bb61-4921-888f-ea0fe0b839c1 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:19.494712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52381a4-bb61-4921-888f-ea0fe0b839c1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:19.494712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52381a4-bb61-4921-888f-ea0fe0b839c1 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:19.496063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 725/1476] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:19.502017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ec81-541f-4977-ac04-6e58fe313d92 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:19.502416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ec81-541f-4977-ac04-6e58fe313d92 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:19.502569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ec81-541f-4977-ac04-6e58fe313d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:19.574173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b3e7ec81-541f-4977-ac04-6e58fe313d92 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:19.575406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b3e7ec81-541f-4977-ac04-6e58fe313d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:19.679359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 752/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:17:19.949380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52381a4-bb61-4921-888f-ea0fe0b839c1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:17:19.950920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e52381a4-bb61-4921-888f-ea0fe0b839c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:20.073725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52381a4-bb61-4921-888f-ea0fe0b839c1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:17:20.120240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:20.164448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795338b-c3d3-4733-8cec-0a72d0165c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:17:20.165048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795338b-c3d3-4733-8cec-0a72d0165c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:20.165320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795338b-c3d3-4733-8cec-0a72d0165c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:20.165583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795338b-c3d3-4733-8cec-0a72d0165c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:20.166208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795338b-c3d3-4733-8cec-0a72d0165c68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:17:20.167936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-0795338b-c3d3-4733-8cec-0a72d0165c68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:17:20.167936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:17:20.167936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:17:20.169082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795338b-c3d3-4733-8cec-0a72d0165c68 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:17:20.187667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 726/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Sep 6 04:17:19 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:17:22.085155 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85f8b9-ddd2-4a79-9fe1-44da3558ef10 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:22.085664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85f8b9-ddd2-4a79-9fe1-44da3558ef10 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:22.085664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85f8b9-ddd2-4a79-9fe1-44da3558ef10 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:22.087022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 753/1479] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:22.092094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2355-82b3-4504-bb71-4298da37ddf9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:22.092529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2355-82b3-4504-bb71-4298da37ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:22.092629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2355-82b3-4504-bb71-4298da37ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:22.158356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-cb8c2355-82b3-4504-bb71-4298da37ddf9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:22.159612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cb8c2355-82b3-4504-bb71-4298da37ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:22.252197 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 727/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:17:22.548963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85f8b9-ddd2-4a79-9fe1-44da3558ef10 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:17:22.550474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3d85f8b9-ddd2-4a79-9fe1-44da3558ef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:22.560207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:22.696146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85f8b9-ddd2-4a79-9fe1-44da3558ef10 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:17:22.774587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:22.807936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed843-6aa9-4625-911e-f570828dd71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:17:22.808461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed843-6aa9-4625-911e-f570828dd71c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:22.808739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed843-6aa9-4625-911e-f570828dd71c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:22.809010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed843-6aa9-4625-911e-f570828dd71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:22.810606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-22aed843-6aa9-4625-911e-f570828dd71c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:22.898457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed843-6aa9-4625-911e-f570828dd71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:17:22.900076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed843-6aa9-4625-911e-f570828dd71c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:17:22.918197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 754/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:17:25.005882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b816-675c-4484-82c1-dd65da55a353 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:25.006316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b816-675c-4484-82c1-dd65da55a353 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:25.006419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b816-675c-4484-82c1-dd65da55a353 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:25.007834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 728/1482] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:25.012995 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e56eab-c0b0-47d2-9fa6-c98e946a67f6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:25.013527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e56eab-c0b0-47d2-9fa6-c98e946a67f6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:25.013527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e56eab-c0b0-47d2-9fa6-c98e946a67f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:25.078880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-26e56eab-c0b0-47d2-9fa6-c98e946a67f6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:25.080116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-26e56eab-c0b0-47d2-9fa6-c98e946a67f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:25.127576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:25.176928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 755/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:17:25.466523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b816-675c-4484-82c1-dd65da55a353 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:17:25.468102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d6e9b816-675c-4484-82c1-dd65da55a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:25.493370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:25.571645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b816-675c-4484-82c1-dd65da55a353 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:17:25.642867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be37fd7-8bc5-405b-a4f2-cfc9d950e3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:17:25.643483 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be37fd7-8bc5-405b-a4f2-cfc9d950e3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:25.643759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be37fd7-8bc5-405b-a4f2-cfc9d950e3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:25.644021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be37fd7-8bc5-405b-a4f2-cfc9d950e3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:25.645615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6be37fd7-8bc5-405b-a4f2-cfc9d950e3a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:25.717192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:25.753568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be37fd7-8bc5-405b-a4f2-cfc9d950e3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:17:25.755016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be37fd7-8bc5-405b-a4f2-cfc9d950e3a9 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:17:25.773096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 729/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:17:27.742056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1c57-4ffd-4583-8f49-f2bd42a21ff6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:27.742620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1c57-4ffd-4583-8f49-f2bd42a21ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:27.742620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1c57-4ffd-4583-8f49-f2bd42a21ff6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:27.744021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 756/1485] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:27.749585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428f301-a9da-487a-b5b3-4c230b1867dd None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:27.750012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428f301-a9da-487a-b5b3-4c230b1867dd None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:27.750204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428f301-a9da-487a-b5b3-4c230b1867dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:27.815289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a428f301-a9da-487a-b5b3-4c230b1867dd None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:27.816528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a428f301-a9da-487a-b5b3-4c230b1867dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:27.914774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 730/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:17:28.206303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1c57-4ffd-4583-8f49-f2bd42a21ff6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:17:28.207920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c8d1c57-4ffd-4583-8f49-f2bd42a21ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:28.310814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1c57-4ffd-4583-8f49-f2bd42a21ff6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:17:28.382013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:28.383779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e284-00e5-410a-99d3-eaa1ca05a271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:17:28.384386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e284-00e5-410a-99d3-eaa1ca05a271 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:28.384853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e284-00e5-410a-99d3-eaa1ca05a271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:28.385288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e284-00e5-410a-99d3-eaa1ca05a271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:28.387050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cdf4e284-00e5-410a-99d3-eaa1ca05a271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:28.494918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4e284-00e5-410a-99d3-eaa1ca05a271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:17:28.496429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4e284-00e5-410a-99d3-eaa1ca05a271 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:17:28.514724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 757/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:17:30.560645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0144-37d4-44e3-9faf-e0f1fd63a197 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:30.561165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0144-37d4-44e3-9faf-e0f1fd63a197 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:30.561165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0144-37d4-44e3-9faf-e0f1fd63a197 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:30.562527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 731/1488] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:30.568458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3ca4-6ad3-4a49-80d4-6fecc03343d0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:30.568920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3ca4-6ad3-4a49-80d4-6fecc03343d0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:30.569025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3ca4-6ad3-4a49-80d4-6fecc03343d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:30.633555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-872b3ca4-6ad3-4a49-80d4-6fecc03343d0 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:30.634750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-872b3ca4-6ad3-4a49-80d4-6fecc03343d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:30.686072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:30.733780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 758/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:17:31.024902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0144-37d4-44e3-9faf-e0f1fd63a197 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:17:31.026445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a92d0144-37d4-44e3-9faf-e0f1fd63a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:31.062848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:31.131463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0144-37d4-44e3-9faf-e0f1fd63a197 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:17:31.202314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ce214-91cd-4282-a6f6-2a34d485447e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:17:31.202912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ce214-91cd-4282-a6f6-2a34d485447e service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:31.203191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ce214-91cd-4282-a6f6-2a34d485447e service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:31.203497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ce214-91cd-4282-a6f6-2a34d485447e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:31.205677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1d8ce214-91cd-4282-a6f6-2a34d485447e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:31.283925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:31.312359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ce214-91cd-4282-a6f6-2a34d485447e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:17:31.313807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ce214-91cd-4282-a6f6-2a34d485447e service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:17:31.332323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 732/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:17:33.427523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204dc8-c936-41a2-87a8-c8885f723022 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:33.428052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204dc8-c936-41a2-87a8-c8885f723022 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:33.428052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204dc8-c936-41a2-87a8-c8885f723022 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:33.429308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 759/1491] 10.222.0.18 () {54 vars in 927 bytes} [Tue Sep 6 04:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:17:33.434384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5d937-52c6-480f-9200-5a026801de2d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:33.434840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5d937-52c6-480f-9200-5a026801de2d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:33.434949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5d937-52c6-480f-9200-5a026801de2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:33.500156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-69e5d937-52c6-480f-9200-5a026801de2d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:17:33.501954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-69e5d937-52c6-480f-9200-5a026801de2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:33.595437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 733/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Sep 6 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:17:33.883920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204dc8-c936-41a2-87a8-c8885f723022 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:17:33.885490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-38204dc8-c936-41a2-87a8-c8885f723022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:33.988873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204dc8-c936-41a2-87a8-c8885f723022 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:17:34.062509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af068d5-4302-498b-98ca-49594a5e8297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:17:34.063668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af068d5-4302-498b-98ca-49594a5e8297 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:17:34.063955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af068d5-4302-498b-98ca-49594a5e8297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:17:34.064223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af068d5-4302-498b-98ca-49594a5e8297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:17:34.065813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9af068d5-4302-498b-98ca-49594a5e8297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:17:34.074656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:34.171943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af068d5-4302-498b-98ca-49594a5e8297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:17:34.173820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af068d5-4302-498b-98ca-49594a5e8297 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:17:34.192415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 760/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:17:43.593606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=82 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:17:44.190027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=50 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:46.049418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:46.049886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:46.049995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:46.125038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:18:46.126222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:46.222735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 734/1494] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:18:46.230625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2871-4a17-4237-ad14-95b3d187f455 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:46.231132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2871-4a17-4237-ad14-95b3d187f455 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:46.231247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2871-4a17-4237-ad14-95b3d187f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:46.307173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d38f2871-4a17-4237-ad14-95b3d187f455 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:18:46.308350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d38f2871-4a17-4237-ad14-95b3d187f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:46.403016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 761/1495] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:18:46.407730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:46.408941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:46.420807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a704754-3e4e-4b00-b6b2-c4cc8206970d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:46.480951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:46.514678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:46.515276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:46.515575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:46.515839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:46.516468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:18:46.516761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:46.517765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:46.517765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:18:46.517765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:18:46.518996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:46.530342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 735/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:18:46.538770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f2871-4a17-4237-ad14-95b3d187f455 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:46.548480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f2871-4a17-4237-ad14-95b3d187f455 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:46.608775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:46.641978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:46.642578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:46.642852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:46.643120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:46.643833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:46.645584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:46.645584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 06 04:18:46.645584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: Sep 06 04:18:46.646778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:46.705585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 762/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:18:46 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:18:46.709891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:46.711513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:46.744966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f29579-2520-4c75-b34f-6f908d0feedf admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:46.836605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:46.837194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:46.837467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:46.837734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:46.838359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:46.839359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:46.839359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:18:46.839359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:18:46.840594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:46.883326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 736/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:18:46 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:18:46.887543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:46.889614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:46.949157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3af74-7958-41a0-a90a-026ae811c505 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:47.032631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:47.043919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:47.044524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:47.044799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:47.045068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:47.045702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:47.046703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:47.046703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 06 04:18:47.046703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: Sep 06 04:18:47.047623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:47.059792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 763/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:18:47.063866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:47.065367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:47.077098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe69b-a6a2-4273-a950-0c5d7c881d6a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:47.101913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:47.171149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e6895-d673-4cba-acae-cb8c31494dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:47.171695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e6895-d673-4cba-acae-cb8c31494dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:47.171966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e6895-d673-4cba-acae-cb8c31494dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:47.172249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e6895-d673-4cba-acae-cb8c31494dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:47.172856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e6895-d673-4cba-acae-cb8c31494dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:47.173851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-311e6895-d673-4cba-acae-cb8c31494dd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:47.173851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:18:47.173851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:18:47.174730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e6895-d673-4cba-acae-cb8c31494dd0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:47.187163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 737/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:18:47.191272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:47.192842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:47.225724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c67b0-25e7-4dfd-b7fa-3beacf821080 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:47.317689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fead18-2293-47b9-9175-a3a13437cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:47.318353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fead18-2293-47b9-9175-a3a13437cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:47.318601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fead18-2293-47b9-9175-a3a13437cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:47.318869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fead18-2293-47b9-9175-a3a13437cce3 admin admin] PATH_INFO: `/v3/projects/6048fe19905d4f2a9f9bc14d8da8961e/users/4a2e61cb623044c78846e382567ddeb8/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:47.340902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fead18-2293-47b9-9175-a3a13437cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6048fe19905d4f2a9f9bc14d8da8961e, user_id=4a2e61cb623044c78846e382567ddeb8, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:47.342071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-85fead18-2293-47b9-9175-a3a13437cce3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:47.342071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 06 04:18:47.342071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: Sep 06 04:18:47.344291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fead18-2293-47b9-9175-a3a13437cce3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:47.367906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 764/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:18:47 2022] PUT /identity/v3/projects/6048fe19905d4f2a9f9bc14d8da8961e/users/4a2e61cb623044c78846e382567ddeb8/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:18:47.380553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982503b4-5e8a-441f-a208-e897a51cb9d4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:47.380835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982503b4-5e8a-441f-a208-e897a51cb9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:47.381106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982503b4-5e8a-441f-a208-e897a51cb9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:47.437316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-982503b4-5e8a-441f-a208-e897a51cb9d4 None None] MFA Rules not processed for user `4a2e61cb623044c78846e382567ddeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:18:47.438445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-982503b4-5e8a-441f-a208-e897a51cb9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:47.515044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 738/1502] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:18:47.528004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cac4d2-56a6-412a-b48e-d80f0a7bf36e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:47.528400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cac4d2-56a6-412a-b48e-d80f0a7bf36e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:47.528675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cac4d2-56a6-412a-b48e-d80f0a7bf36e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:47.530050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 765/1503] 10.222.0.18 () {54 vars in 964 bytes} [Tue Sep 6 04:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:18:47.534646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a9dcb-f890-4f1a-bf25-19ac04ac9859 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:47.534929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a9dcb-f890-4f1a-bf25-19ac04ac9859 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:47.535200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a9dcb-f890-4f1a-bf25-19ac04ac9859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:47.567282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:47.610317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f61a9dcb-f890-4f1a-bf25-19ac04ac9859 None None] MFA Rules not processed for user `fa181d21ba124c4ba2efd96ddecf5f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:18:47.611536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f61a9dcb-f890-4f1a-bf25-19ac04ac9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:47.684700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 739/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Sep 6 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:18:47.692953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cac4d2-56a6-412a-b48e-d80f0a7bf36e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:47.694433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-82cac4d2-56a6-412a-b48e-d80f0a7bf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:47.742946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:47.796722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cac4d2-56a6-412a-b48e-d80f0a7bf36e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:47.869029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:47.869630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:47.869907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:47.870174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:47.871784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:47.968942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:47.970304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:47.973805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:47.989258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 766/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:18:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:18:48.034049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a9562-21be-4cab-9018-bd8ce3318e96 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:48.034333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a9562-21be-4cab-9018-bd8ce3318e96 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:48.034810 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a9562-21be-4cab-9018-bd8ce3318e96 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:48.036109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 740/1506] 10.222.0.18 () {52 vars in 830 bytes} [Tue Sep 6 04:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:18:48.039654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:48.040847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:48.137163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87e200-d0d6-456e-8126-45a65c3a2206 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:48.228087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:48.228639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:48.228912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:48.229178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] PATH_INFO: `/v3/users/4a2e61cb623044c78846e382567ddeb8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:48.241662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2e61cb623044c78846e382567ddeb8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:48.242669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:48.242669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 06 04:18:48.242669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: Sep 06 04:18:48.243920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:48.253705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:48.310537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2e61cb623044c78846e382567ddeb8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:48.324131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2e61cb623044c78846e382567ddeb8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:48.347540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2e61cb623044c78846e382567ddeb8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:48.347997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2e61cb623044c78846e382567ddeb8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:48.348516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2e61cb623044c78846e382567ddeb8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:48.362767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 767/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:18:48 2022] DELETE /identity/v3/users/4a2e61cb623044c78846e382567ddeb8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:18:48.367150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:48.367641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:48.367735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:48.423363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:18:48.424575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:48.497763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:48.511337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 741/1508] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:18:48.521385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:48.522706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:48.622524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50503006-4ec1-49c3-b140-2ea0eb01c893 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:48.676182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:48.696761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bc514-b4b4-4903-b9d5-3cd2945518c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:48.697367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc514-b4b4-4903-b9d5-3cd2945518c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:48.697643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc514-b4b4-4903-b9d5-3cd2945518c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:48.697908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc514-b4b4-4903-b9d5-3cd2945518c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:48.699522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-205bc514-b4b4-4903-b9d5-3cd2945518c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:48.805869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bc514-b4b4-4903-b9d5-3cd2945518c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:48.807233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bc514-b4b4-4903-b9d5-3cd2945518c3 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:48.825693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 768/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:18:49.160471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:18:49.161738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:18:49.173854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa642c7-7659-466d-ba22-f2c39035c37a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:18:49.271316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:18:49.271976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:18:49.272252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:18:49.272517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] PATH_INFO: `/v3/projects/6048fe19905d4f2a9f9bc14d8da8961e` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:18:49.283672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6048fe19905d4f2a9f9bc14d8da8961e)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:18:49.284705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:18:49.284705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:18:49.284705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:18:49.285908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:18:49.343791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6048fe19905d4f2a9f9bc14d8da8961e', 'request_id': 'req-6af344bf-852b-4236-9a31-826decf4bd35'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:49.352476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6048fe19905d4f2a9f9bc14d8da8961e', 'request_id': 'req-6af344bf-852b-4236-9a31-826decf4bd35'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:49.358711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6048fe19905d4f2a9f9bc14d8da8961e', 'request_id': 'req-6af344bf-852b-4236-9a31-826decf4bd35'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:49.387606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] The token cache is being invalidate because project 6048fe19905d4f2a9f9bc14d8da8961e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:18:49.388192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:49.388306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6af344bf-852b-4236-9a31-826decf4bd35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:18:49.390207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 742/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:18:49 2022] DELETE /identity/v3/projects/6048fe19905d4f2a9f9bc14d8da8961e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:18:58.823575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=62 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:18:59.385631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:20:20.534201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4e10-c757-40ab-b7ec-60f010e2b66c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:20.534803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4e10-c757-40ab-b7ec-60f010e2b66c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:20.534803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4e10-c757-40ab-b7ec-60f010e2b66c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:20.536131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:20.540840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985e5c-b67a-4b9b-b958-4e72ad598448 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:20.541282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985e5c-b67a-4b9b-b958-4e72ad598448 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:20.541476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985e5c-b67a-4b9b-b958-4e72ad598448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:20.621481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-eb985e5c-b67a-4b9b-b958-4e72ad598448 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:20.622939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-eb985e5c-b67a-4b9b-b958-4e72ad598448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:20.726786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:20.882826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f4e10-c757-40ab-b7ec-60f010e2b66c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:20.885005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-018f4e10-c757-40ab-b7ec-60f010e2b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:21.001770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f4e10-c757-40ab-b7ec-60f010e2b66c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:21.007193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eea0a8-d35d-4abb-95eb-52bdde080ae2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:21.007846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea0a8-d35d-4abb-95eb-52bdde080ae2 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:21.008126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea0a8-d35d-4abb-95eb-52bdde080ae2 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:21.008391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea0a8-d35d-4abb-95eb-52bdde080ae2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:21.016776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eea0a8-d35d-4abb-95eb-52bdde080ae2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:21.018340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eea0a8-d35d-4abb-95eb-52bdde080ae2 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:21.027688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 770/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:21.852105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11544e44-e655-45d9-b6d7-3572aba94792 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:21.852697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11544e44-e655-45d9-b6d7-3572aba94792 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:21.852697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11544e44-e655-45d9-b6d7-3572aba94792 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:21.854007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:21.858641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06b510-775d-44c7-b8e3-f0c536fa501c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:21.859124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06b510-775d-44c7-b8e3-f0c536fa501c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:21.859233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06b510-775d-44c7-b8e3-f0c536fa501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:21.878598 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0c06b510-775d-44c7-b8e3-f0c536fa501c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:21.879835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c06b510-775d-44c7-b8e3-f0c536fa501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:21.887704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:22.038433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11544e44-e655-45d9-b6d7-3572aba94792 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:22.053530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11544e44-e655-45d9-b6d7-3572aba94792 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:22.058951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf45f0-56e2-4bb1-90ea-08f9bf22a4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:22.059579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf45f0-56e2-4bb1-90ea-08f9bf22a4d7 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:22.059858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf45f0-56e2-4bb1-90ea-08f9bf22a4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:22.060132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf45f0-56e2-4bb1-90ea-08f9bf22a4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:22.068038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf45f0-56e2-4bb1-90ea-08f9bf22a4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:22.069634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf45f0-56e2-4bb1-90ea-08f9bf22a4d7 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:22.078851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 745/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:22.391176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdd2d-e1bd-46b5-ba04-cc6934950583 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:22.391415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdd2d-e1bd-46b5-ba04-cc6934950583 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:22.391661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdd2d-e1bd-46b5-ba04-cc6934950583 None None] PATH_INFO: `/v3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:22.392933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 772/1517] 10.222.0.23 () {54 vars in 925 bytes} [Tue Sep 6 04:20:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:20:22.399365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfdd-eb85-4498-a5a8-1637457997d8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:22.399681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfdd-eb85-4498-a5a8-1637457997d8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:22.399958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfdd-eb85-4498-a5a8-1637457997d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:22.460187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5621cfdd-eb85-4498-a5a8-1637457997d8 None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:22.461395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5621cfdd-eb85-4498-a5a8-1637457997d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:22.477799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:20:22.532729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 746/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Sep 6 04:20:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:31.873892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=56 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:20:32.529921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=23 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:20:33.319083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea84c4-9524-4c2a-93dd-270732318e02 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:33.319630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea84c4-9524-4c2a-93dd-270732318e02 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:33.319630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea84c4-9524-4c2a-93dd-270732318e02 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:33.321391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 773/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:20:33.326418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f48b-ec40-4fbb-b69c-207310cf593e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:33.326705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f48b-ec40-4fbb-b69c-207310cf593e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:33.326977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f48b-ec40-4fbb-b69c-207310cf593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:33.347507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-dfe7f48b-ec40-4fbb-b69c-207310cf593e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:33.348737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-dfe7f48b-ec40-4fbb-b69c-207310cf593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:33.358411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 747/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:33.511585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea84c4-9524-4c2a-93dd-270732318e02 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:33.527528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea84c4-9524-4c2a-93dd-270732318e02 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:33.535154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fc30b-f42b-4f47-b057-0dfa458e296e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:33.535786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc30b-f42b-4f47-b057-0dfa458e296e service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:33.536060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc30b-f42b-4f47-b057-0dfa458e296e service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:33.536325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc30b-f42b-4f47-b057-0dfa458e296e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:33.545301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fc30b-f42b-4f47-b057-0dfa458e296e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:33.546896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fc30b-f42b-4f47-b057-0dfa458e296e service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:33.556721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 774/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:33.790701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc354-1896-4d84-90e7-6681f3f16534 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:33.791272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc354-1896-4d84-90e7-6681f3f16534 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:33.791411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc354-1896-4d84-90e7-6681f3f16534 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:33.792878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 748/1522] 10.222.0.18 () {54 vars in 961 bytes} [Tue Sep 6 04:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:33.798661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f992c-6ec8-4263-b450-549212d9658a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:33.799018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f992c-6ec8-4263-b450-549212d9658a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:33.799361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f992c-6ec8-4263-b450-549212d9658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:33.819142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-138f992c-6ec8-4263-b450-549212d9658a None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:33.820364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-138f992c-6ec8-4263-b450-549212d9658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:33.828877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 775/1523] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Sep 6 04:20:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:33.836591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc354-1896-4d84-90e7-6681f3f16534 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:33.849634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc354-1896-4d84-90e7-6681f3f16534 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:33.854661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850b046-98af-4306-a9be-bfbaf98a6c58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:33.855250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b046-98af-4306-a9be-bfbaf98a6c58 service placement] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:33.855561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b046-98af-4306-a9be-bfbaf98a6c58 service placement] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:33.855827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b046-98af-4306-a9be-bfbaf98a6c58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:33.864645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b046-98af-4306-a9be-bfbaf98a6c58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:33.866215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b046-98af-4306-a9be-bfbaf98a6c58 service placement] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:33.876466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 749/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:34.369891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4999ef-9f3e-4073-a2d9-cf0bbea7bba8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:34.370448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4999ef-9f3e-4073-a2d9-cf0bbea7bba8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:34.370448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4999ef-9f3e-4073-a2d9-cf0bbea7bba8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:34.372119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 04:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:34.377047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9316-15fd-45a4-90a3-6b0a6ae6b3c8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:34.377323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9316-15fd-45a4-90a3-6b0a6ae6b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:34.377593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9316-15fd-45a4-90a3-6b0a6ae6b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:34.396915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5e1e9316-15fd-45a4-90a3-6b0a6ae6b3c8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:34.398097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5e1e9316-15fd-45a4-90a3-6b0a6ae6b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:34.406378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:34.557664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4999ef-9f3e-4073-a2d9-cf0bbea7bba8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:34.571677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4999ef-9f3e-4073-a2d9-cf0bbea7bba8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:34.578233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5ceb-c60f-41fc-b46c-c612e34f4799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:34.578817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5ceb-c60f-41fc-b46c-c612e34f4799 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:34.579092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5ceb-c60f-41fc-b46c-c612e34f4799 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:34.579418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5ceb-c60f-41fc-b46c-c612e34f4799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:34.587520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5ceb-c60f-41fc-b46c-c612e34f4799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:34.589080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5ceb-c60f-41fc-b46c-c612e34f4799 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:34.598975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 777/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:38.437905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f089f-b52f-4431-a808-acdb48216052 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:38.438441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f089f-b52f-4431-a808-acdb48216052 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:38.438441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f089f-b52f-4431-a808-acdb48216052 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:38.439848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:38.444896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bbed6-860c-4d57-bb1d-699708e46eb3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:38.445319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bbed6-860c-4d57-bb1d-699708e46eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:38.445433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bbed6-860c-4d57-bb1d-699708e46eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:38.464919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6d8bbed6-860c-4d57-bb1d-699708e46eb3 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:38.466112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d8bbed6-860c-4d57-bb1d-699708e46eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:38.473845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:38.758344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f089f-b52f-4431-a808-acdb48216052 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:38.760073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-009f089f-b52f-4431-a808-acdb48216052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:38.838527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f089f-b52f-4431-a808-acdb48216052 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:38.842119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55644e-314b-4438-ba6d-902923354fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:38.842740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55644e-314b-4438-ba6d-902923354fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:38.843018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55644e-314b-4438-ba6d-902923354fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:38.843287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55644e-314b-4438-ba6d-902923354fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:38.852053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55644e-314b-4438-ba6d-902923354fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:38.853489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55644e-314b-4438-ba6d-902923354fa3 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:38.863419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 752/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:40.753289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb3cf-b239-49e1-a79a-161f233ea49b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:40.753823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb3cf-b239-49e1-a79a-161f233ea49b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:40.753823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb3cf-b239-49e1-a79a-161f233ea49b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:40.755168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:40.760475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918966bb-56cd-48f3-9b3c-8bd22cd25568 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:40.760866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918966bb-56cd-48f3-9b3c-8bd22cd25568 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:40.761014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918966bb-56cd-48f3-9b3c-8bd22cd25568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:40.780850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-918966bb-56cd-48f3-9b3c-8bd22cd25568 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:40.782043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-918966bb-56cd-48f3-9b3c-8bd22cd25568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:40.789840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:41.073547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb3cf-b239-49e1-a79a-161f233ea49b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:41.084832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb3cf-b239-49e1-a79a-161f233ea49b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:41.088309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc1bf9-4acf-4b5d-86c7-0addc1cd2242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:41.088896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc1bf9-4acf-4b5d-86c7-0addc1cd2242 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:41.089174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc1bf9-4acf-4b5d-86c7-0addc1cd2242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:41.089445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc1bf9-4acf-4b5d-86c7-0addc1cd2242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:41.098798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc1bf9-4acf-4b5d-86c7-0addc1cd2242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:41.100250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc1bf9-4acf-4b5d-86c7-0addc1cd2242 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:41.109419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 780/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:44.486016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce6d7-2b3a-4609-bc06-76c217c5de3e None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:44.486573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce6d7-2b3a-4609-bc06-76c217c5de3e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:44.486573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce6d7-2b3a-4609-bc06-76c217c5de3e None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:44.488211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:44.493506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67e9a-e10f-4a00-b2f9-12e2bd3436a1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:44.493898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67e9a-e10f-4a00-b2f9-12e2bd3436a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:44.494056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67e9a-e10f-4a00-b2f9-12e2bd3436a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:44.514098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4be67e9a-e10f-4a00-b2f9-12e2bd3436a1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:44.515300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4be67e9a-e10f-4a00-b2f9-12e2bd3436a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:44.523099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:45.079240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cce6d7-2b3a-4609-bc06-76c217c5de3e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:45.080991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-22cce6d7-2b3a-4609-bc06-76c217c5de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:45.159133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cce6d7-2b3a-4609-bc06-76c217c5de3e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:45.162714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c385bb9-5eda-45de-91db-761d75d5175a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:45.163307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c385bb9-5eda-45de-91db-761d75d5175a service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:45.163622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c385bb9-5eda-45de-91db-761d75d5175a service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:45.163875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c385bb9-5eda-45de-91db-761d75d5175a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:45.172590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c385bb9-5eda-45de-91db-761d75d5175a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:45.174014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c385bb9-5eda-45de-91db-761d75d5175a service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:45.183141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 755/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:47.112198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792aca9-33c8-4b80-922f-562adc9381f2 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:47.112717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792aca9-33c8-4b80-922f-562adc9381f2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:47.112717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792aca9-33c8-4b80-922f-562adc9381f2 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:47.114084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 04:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:20:47.119353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a4215-dd91-4896-b597-cc44af0f975f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:47.119750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a4215-dd91-4896-b597-cc44af0f975f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:47.119927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a4215-dd91-4896-b597-cc44af0f975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:47.139876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d46a4215-dd91-4896-b597-cc44af0f975f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:20:47.141053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d46a4215-dd91-4896-b597-cc44af0f975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:47.148745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:20:47.707606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792aca9-33c8-4b80-922f-562adc9381f2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:20:47.709264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3792aca9-33c8-4b80-922f-562adc9381f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:20:47.722583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792aca9-33c8-4b80-922f-562adc9381f2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:20:47.726088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ee114-a27f-41e1-857e-4b013477549e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:20:47.726672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ee114-a27f-41e1-857e-4b013477549e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:20:47.726981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ee114-a27f-41e1-857e-4b013477549e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:20:47.727248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ee114-a27f-41e1-857e-4b013477549e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:20:47.736640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ee114-a27f-41e1-857e-4b013477549e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:20:47.738044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ee114-a27f-41e1-857e-4b013477549e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:20:47.747513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 783/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:20:57.135127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:20:57.743106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=33 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:13.535918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27dd03-2bc9-4b5b-aab8-e0e15f0550e7 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.539836 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27dd03-2bc9-4b5b-aab8-e0e15f0550e7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.539836 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27dd03-2bc9-4b5b-aab8-e0e15f0550e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.562315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8a27dd03-2bc9-4b5b-aab8-e0e15f0550e7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:13.563592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8a27dd03-2bc9-4b5b-aab8-e0e15f0550e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:13.576966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 757/1540] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:13.586003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d2e3e-c8fb-4f6f-a13e-513f5c020e8c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.586614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d2e3e-c8fb-4f6f-a13e-513f5c020e8c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.586614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d2e3e-c8fb-4f6f-a13e-513f5c020e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.613284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d90d2e3e-c8fb-4f6f-a13e-513f5c020e8c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:13.614777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d90d2e3e-c8fb-4f6f-a13e-513f5c020e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:13.626816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 784/1541] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:13.632368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27dd03-2bc9-4b5b-aab8-e0e15f0550e7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:13.651310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27dd03-2bc9-4b5b-aab8-e0e15f0550e7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:13.658207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:13.658834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.659111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.659406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.660066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:13.660374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:13.662016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:13.662440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89713d-da5b-40dc-920b-a8d2883cbd79 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.662723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89713d-da5b-40dc-920b-a8d2883cbd79 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.662998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89713d-da5b-40dc-920b-a8d2883cbd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.684084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 758/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:22:13.688097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0b89713d-da5b-40dc-920b-a8d2883cbd79 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:13.689313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0b89713d-da5b-40dc-920b-a8d2883cbd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:13.693017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:13.708706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 785/1543] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:13.710393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aa061-8cad-48c1-8ef1-0ff406af427a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:13.717589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88023a3-478d-4847-a60c-d1e816673e55 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.717873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88023a3-478d-4847-a60c-d1e816673e55 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.718146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88023a3-478d-4847-a60c-d1e816673e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.720110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd13f3c-2008-49b0-bffb-3a95f7bc931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:13.720728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd13f3c-2008-49b0-bffb-3a95f7bc931a admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.721007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd13f3c-2008-49b0-bffb-3a95f7bc931a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.721358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd13f3c-2008-49b0-bffb-3a95f7bc931a admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.722016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd13f3c-2008-49b0-bffb-3a95f7bc931a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:13.723053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-ecd13f3c-2008-49b0-bffb-3a95f7bc931a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:22:13.723053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:22:13.723053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:22:13.724301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd13f3c-2008-49b0-bffb-3a95f7bc931a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:13.760974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c88023a3-478d-4847-a60c-d1e816673e55 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:13.762360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c88023a3-478d-4847-a60c-d1e816673e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:13.777066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 786/1544] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:13.779514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f857c4-9109-4e65-8d48-378eeb091b8a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.779798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f857c4-9109-4e65-8d48-378eeb091b8a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.780065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f857c4-9109-4e65-8d48-378eeb091b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.813829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 759/1545] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:22:13.815027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0105d-99a6-462a-955b-8bef6ed12c0a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.815311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0105d-99a6-462a-955b-8bef6ed12c0a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.815611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0105d-99a6-462a-955b-8bef6ed12c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.827057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e6f857c4-9109-4e65-8d48-378eeb091b8a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:13.828294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e6f857c4-9109-4e65-8d48-378eeb091b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:13.847250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6da0105d-99a6-462a-955b-8bef6ed12c0a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:13.848983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6da0105d-99a6-462a-955b-8bef6ed12c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:13.921070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 787/1546] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:13.923489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f857c4-9109-4e65-8d48-378eeb091b8a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:13.933092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f857c4-9109-4e65-8d48-378eeb091b8a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:13.938415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:13.939007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.939282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.939590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.940232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:13.940532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:13.941538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:22:13.941538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 06 04:22:13.941538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: Sep 06 04:22:13.942422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02801ee-af52-4940-9310-ca51a62e3696 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:13.943866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 760/1547] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:13.944539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0105d-99a6-462a-955b-8bef6ed12c0a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:13.956771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0105d-99a6-462a-955b-8bef6ed12c0a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:13.958088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 788/1548] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:13.959508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605e49-d5cb-4754-8011-57781a6078c6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.959793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605e49-d5cb-4754-8011-57781a6078c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.960076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605e49-d5cb-4754-8011-57781a6078c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.962911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2498a-a7d3-4197-80b2-8ac565885c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:13.963660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2498a-a7d3-4197-80b2-8ac565885c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.963879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2498a-a7d3-4197-80b2-8ac565885c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.964150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2498a-a7d3-4197-80b2-8ac565885c76 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.964776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2498a-a7d3-4197-80b2-8ac565885c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:13.966851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2498a-a7d3-4197-80b2-8ac565885c76 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:13.980029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-56605e49-d5cb-4754-8011-57781a6078c6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:13.982128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-56605e49-d5cb-4754-8011-57781a6078c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:13.989898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 761/1549] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:13.990942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 789/1550] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:13.991733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025c2cc-fffa-4925-8d48-092b732222d4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.992201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6983cc-6409-4b22-a967-aa9868a90bb5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:13.992443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025c2cc-fffa-4925-8d48-092b732222d4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.992563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6983cc-6409-4b22-a967-aa9868a90bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:13.992746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6983cc-6409-4b22-a967-aa9868a90bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:13.993179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025c2cc-fffa-4925-8d48-092b732222d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.018235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a025c2cc-fffa-4925-8d48-092b732222d4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.018635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fd6983cc-6409-4b22-a967-aa9868a90bb5 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.019735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a025c2cc-fffa-4925-8d48-092b732222d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.019873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fd6983cc-6409-4b22-a967-aa9868a90bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.027666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 762/1551] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.027783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 790/1552] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.029509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41c0a-1daf-4d51-984e-7f8b62e660ad None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.029798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41c0a-1daf-4d51-984e-7f8b62e660ad None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.030072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41c0a-1daf-4d51-984e-7f8b62e660ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.032762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145ab0-a5ad-47ac-86b8-beb16083568c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.033330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145ab0-a5ad-47ac-86b8-beb16083568c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.033854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145ab0-a5ad-47ac-86b8-beb16083568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.050815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-27e41c0a-1daf-4d51-984e-7f8b62e660ad None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.052072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-27e41c0a-1daf-4d51-984e-7f8b62e660ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.058734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-25145ab0-a5ad-47ac-86b8-beb16083568c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.059974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-25145ab0-a5ad-47ac-86b8-beb16083568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.060528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 791/1553] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.061894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d5b73-17ce-43aa-b630-cc63f89fd4a7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.062175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d5b73-17ce-43aa-b630-cc63f89fd4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.062452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d5b73-17ce-43aa-b630-cc63f89fd4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.071108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 763/1554] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.071892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145ab0-a5ad-47ac-86b8-beb16083568c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.083341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145ab0-a5ad-47ac-86b8-beb16083568c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.087910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14224ffc-e75d-4da7-b523-a5da9f52de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.088496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224ffc-e75d-4da7-b523-a5da9f52de92 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.088772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224ffc-e75d-4da7-b523-a5da9f52de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.089034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224ffc-e75d-4da7-b523-a5da9f52de92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.089183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-791d5b73-17ce-43aa-b630-cc63f89fd4a7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.089652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14224ffc-e75d-4da7-b523-a5da9f52de92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.090387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-791d5b73-17ce-43aa-b630-cc63f89fd4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.092134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14224ffc-e75d-4da7-b523-a5da9f52de92 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.098682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 792/1555] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.099481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d5b73-17ce-43aa-b630-cc63f89fd4a7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.109035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d5b73-17ce-43aa-b630-cc63f89fd4a7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.114477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca788b6-8e22-4814-bbd7-8f2989c6ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.115185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca788b6-8e22-4814-bbd7-8f2989c6ffbf admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.115585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca788b6-8e22-4814-bbd7-8f2989c6ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.115937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca788b6-8e22-4814-bbd7-8f2989c6ffbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.116583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca788b6-8e22-4814-bbd7-8f2989c6ffbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.118175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca788b6-8e22-4814-bbd7-8f2989c6ffbf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.125790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 764/1556] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.125790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deaabf-5c1c-4265-8605-7f055ed6dff4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.125790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deaabf-5c1c-4265-8605-7f055ed6dff4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.125790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deaabf-5c1c-4265-8605-7f055ed6dff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.131592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 793/1557] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:14.131592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb070-ff8b-46e3-a065-2c58bd66ca5f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.131592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb070-ff8b-46e3-a065-2c58bd66ca5f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.131592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb070-ff8b-46e3-a065-2c58bd66ca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.147106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c1deaabf-5c1c-4265-8605-7f055ed6dff4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.148351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c1deaabf-5c1c-4265-8605-7f055ed6dff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.149438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c3cbb070-ff8b-46e3-a065-2c58bd66ca5f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.150602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c3cbb070-ff8b-46e3-a065-2c58bd66ca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.200355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:14.210597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 765/1558] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.211794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 794/1559] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.211937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab025fb-fe26-4ec8-9a3d-71155341848e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.212158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab025fb-fe26-4ec8-9a3d-71155341848e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.212432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab025fb-fe26-4ec8-9a3d-71155341848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.213278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbb070-ff8b-46e3-a065-2c58bd66ca5f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.224580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbb070-ff8b-46e3-a065-2c58bd66ca5f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.230134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.230741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.231027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.231302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.232614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:14.232782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8ab025fb-fe26-4ec8-9a3d-71155341848e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.232919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.233996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8ab025fb-fe26-4ec8-9a3d-71155341848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.234521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.242341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 766/1560] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.243678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b3e5-73a3-4ae6-8393-bc83ac4f7e94 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.244210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b3e5-73a3-4ae6-8393-bc83ac4f7e94 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.244494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b3e5-73a3-4ae6-8393-bc83ac4f7e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.247489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 795/1561] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:14.248539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.258340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6845d5-c7fc-4dd7-a938-30237e6ae779 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.262879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.263475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.263775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.264043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.264666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:14.264962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.266540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.270701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a2b8b3e5-73a3-4ae6-8393-bc83ac4f7e94 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.271932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a2b8b3e5-73a3-4ae6-8393-bc83ac4f7e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.279560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 796/1562] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:14.280271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 767/1563] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.280395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.281039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b3e5-73a3-4ae6-8393-bc83ac4f7e94 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.286698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:14.291664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a0b5-c8e1-4760-8951-e06224af3770 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.292165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b3e5-73a3-4ae6-8393-bc83ac4f7e94 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.297671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.298263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.298482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.298605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.298785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.299061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.299333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.299458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.299628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.300252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.301034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.301237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:22:14.301237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 06 04:22:14.301237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: Sep 06 04:22:14.302589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.313149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 768/1564] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:14.313998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.326175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f420e-3dc3-46dc-bf48-9ab66ce8fb75 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.326368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 797/1565] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.327473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.330970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.331626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.332025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.332435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.332936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:14.333239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.334832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.337356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6907e-6c68-4dc5-a410-8fc0a893aafc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.342514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.343097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.343390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.343673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.344310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:14.344609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.346202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.354053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 769/1566] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:14.355103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.366700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 798/1567] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:14.367634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.370594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd1c5-3232-4125-b614-274888d08c82 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.378708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.379449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.379925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.380148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.381119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:14.381463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.382317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971f22-4ce4-4cbb-a270-a50d2d829415 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.383495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.388398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.388991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.389389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.389662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.390294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.392248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.403201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 770/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:14.403201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.408917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9956c-90a8-4134-8b6e-220fd133fae6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.413807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.417306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.417584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.417852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.418480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.420458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.424947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 799/1569] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.424947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.452411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 771/1570] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.452411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.488157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985180a-2610-452e-950c-f8cb9d1819b1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.515711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77806-8cf6-4b87-91df-84e339e2a3f2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.520467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.521111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.521387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.521658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] PATH_INFO: `/v3/projects/19b9531b3d7c4969b62f404dab5dba5d/users/208fda1fb75d43729d8eef8c89f8cd12/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.537063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b9531b3d7c4969b62f404dab5dba5d, user_id=208fda1fb75d43729d8eef8c89f8cd12, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.538083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:22:14.538083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:22:14.538083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:22:14.540170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.544349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.544982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.545313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.545528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.546170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:14.546464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.548078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.552595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 772/1571] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:14 2022] PUT /identity/v3/projects/19b9531b3d7c4969b62f404dab5dba5d/users/208fda1fb75d43729d8eef8c89f8cd12/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:14.553540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.563772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 800/1572] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:14.564452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.574195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37aec-5d5a-4a54-86de-d65c4d239a43 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.619322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c4332-fde0-4a0f-adaa-6b6ae1c7060b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.623850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:14.624366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.624649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.624985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.625294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.626122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.627920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.635029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.635673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.635948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.636216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.636842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.638893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 773/1573] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:14.639325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.642303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.646539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:14.650720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90c238-664e-4c6e-8717-5b4f43c0eed8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.657204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.657809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.658086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.658384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.658978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.660933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.671625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 801/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.671625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.688757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 774/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.689566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.736748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c28130-5696-4048-89e4-7fc378947522 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.751516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceb532-9616-4fac-8c97-25566ec042c9 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.756205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.757010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.757132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.757337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.757966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.759939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.784390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 775/1576] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.784390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.792346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f8d7-445c-48ae-9322-e13a8d90f3a5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.797310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763a47-9d6f-438c-a4b9-8285da47b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.797900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763a47-9d6f-438c-a4b9-8285da47b062 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.798177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763a47-9d6f-438c-a4b9-8285da47b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.798390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.798515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763a47-9d6f-438c-a4b9-8285da47b062 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.798992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.799163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763a47-9d6f-438c-a4b9-8285da47b062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.799266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.799555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.800182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.801141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763a47-9d6f-438c-a4b9-8285da47b062 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.802195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.825049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 776/1577] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.827055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e333-81ae-431b-a76c-24291942554a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.827340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e333-81ae-431b-a76c-24291942554a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.827666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e333-81ae-431b-a76c-24291942554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.833242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 802/1578] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.833242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.851558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6fd3e333-81ae-431b-a76c-24291942554a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:14.852768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6fd3e333-81ae-431b-a76c-24291942554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:14.899476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f53f17-eef5-4228-ae62-5a6531334d68 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.904311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.904919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.905195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.905463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.906092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.908102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.912625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 777/1579] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:14.913465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e333-81ae-431b-a76c-24291942554a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.922662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e333-81ae-431b-a76c-24291942554a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:14.925177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:14.927577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:14.928174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:14.928448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:14.928720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:14.929385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:14.930966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:14.938725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 803/1580] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:14.940275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.945475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 778/1581] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:14.945475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:14.953326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1084c-eca4-4178-92c9-e07de5127519 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.000454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:15.015883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac7a0-9ea5-4ef1-8571-c0ef29f8ee6e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.017548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.018160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.018435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.018702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.019328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.020439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.021037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.021310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.021417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.021577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.022222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.024168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.044492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 779/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:15.045313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.046635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 804/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:14 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:15.047610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.057519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfea91-b758-4733-8871-4300f58f86b5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.058686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b25c0-4fe5-400b-8143-639e199147ba admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.062650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.063230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.063547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.063688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.063821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.064299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.064453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.064578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.064846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.065478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.066053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.067074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.076549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 805/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.077412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.081482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 780/1585] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.081482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.086787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172939-6f06-4625-88e1-411697693469 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.091338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.091978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.092274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.092523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.093144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.095048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.118788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 806/1586] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:15 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:15.119884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.129766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2656-f7e8-4001-a2bb-4ffc1628d041 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.134540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.135104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.135397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.135679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.136296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.138889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.143804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1e03-cb9c-47b8-ada8-a6f7f50e10c5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.147445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.148049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.148322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.148588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.158629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.159956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 807/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:15 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:15.163269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.163403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.170881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 781/1588] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:15.171324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adaa48-5350-48e4-8d43-479cf8bb2a3c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.171581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.176205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.176854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.177140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.177415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] PATH_INFO: `/v3/projects/731e7a7c03f24df684b39c256a0f1bfb/users/37a1aad7df51440b9e7e8703598d0618/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.181016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff6bf-d513-43a0-be37-d05a3485c271 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.186884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.187585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.187925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.188265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.189075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.190822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.196229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=731e7a7c03f24df684b39c256a0f1bfb, user_id=37a1aad7df51440b9e7e8703598d0618, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.199261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.206031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 782/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.206031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.214184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363d43c-4a23-4d71-abe2-bb1e85434efc admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.215273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 808/1590] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:15 2022] PUT /identity/v3/projects/731e7a7c03f24df684b39c256a0f1bfb/users/37a1aad7df51440b9e7e8703598d0618/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:15.216001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.287841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e82d0-d89f-44cd-8c1c-f0e64ef338ec admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.294605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.295250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.295601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.295866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.296508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.298190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.312616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 809/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.312616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.312888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.312888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.312888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.313169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.313830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.315425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.324331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1e63b-8f84-4250-b690-a61c80dae239 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.327691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 783/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.328557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.331914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.332667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.333036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.333415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.334159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.335961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.339872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0c235-e7a6-48ff-a46a-e7cd1cbf934d admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.343922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:15.348243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.348243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.348243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.348243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.348533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.352871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.357323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 810/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.357323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.370689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e6a8-4de4-46d8-bb04-415d7ea747a4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.376803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 784/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.376803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.379785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ffa66-ec6d-427f-812d-3a066312b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.380421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ffa66-ec6d-427f-812d-3a066312b070 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.380694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ffa66-ec6d-427f-812d-3a066312b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.380957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ffa66-ec6d-427f-812d-3a066312b070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.381591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ffa66-ec6d-427f-812d-3a066312b070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.383203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ffa66-ec6d-427f-812d-3a066312b070 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.390634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba3871-1f9d-4749-b960-8738d1579936 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.395093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 811/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.397960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.398688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.399040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.399398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.399630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615149-7f25-4425-bac8-2da6a0649f77 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.399943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615149-7f25-4425-bac8-2da6a0649f77 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.400215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615149-7f25-4425-bac8-2da6a0649f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.400345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.402243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.415417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 785/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.416448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.427020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c2a1-5e0d-441f-b9b4-78fa217d799a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.429838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-82615149-7f25-4425-bac8-2da6a0649f77 None None] MFA Rules not processed for user `37a1aad7df51440b9e7e8703598d0618`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:15.431032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-82615149-7f25-4425-bac8-2da6a0649f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:15.432021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.432746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.433114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.433450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] PATH_INFO: `/v3/projects/31d315b079404c0fb4554135d315def6/users/f8f46235d0d34ba5bbb60e675002fc6e/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.453537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d315b079404c0fb4554135d315def6, user_id=f8f46235d0d34ba5bbb60e675002fc6e, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.457182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.473858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 786/1597] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:15 2022] PUT /identity/v3/projects/31d315b079404c0fb4554135d315def6/users/f8f46235d0d34ba5bbb60e675002fc6e/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:15.474485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.488867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:15.522031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 812/1598] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:15.523024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82615149-7f25-4425-bac8-2da6a0649f77 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.543772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82615149-7f25-4425-bac8-2da6a0649f77 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.566404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e2f5-51a0-426b-9ffa-630036bfa464 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.571851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.572571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.572949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.573318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.574113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.575982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.591504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 787/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.591504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.601850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0116d60-b750-4779-9fdd-80c469a4d86c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.609358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.610171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.610577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.611005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.611934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.614217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.628316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 788/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.629040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.629328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3a936-ac2a-4755-a17b-997ba42e5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.630010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3a936-ac2a-4755-a17b-997ba42e5335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.630287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3a936-ac2a-4755-a17b-997ba42e5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.630561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3a936-ac2a-4755-a17b-997ba42e5335 admin admin] PATH_INFO: `/v3/projects/abbad2c79d0b4ab785f579ce425c14b7/users/e19e8da2dd5a47abac84aa87cbedb21f/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.640555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13868a-1925-4930-93d8-1fa4befc4ded admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.646491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.647125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.648446 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3a936-ac2a-4755-a17b-997ba42e5335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbad2c79d0b4ab785f579ce425c14b7, user_id=e19e8da2dd5a47abac84aa87cbedb21f, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.648787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.649143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.649895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.651678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.652078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3a936-ac2a-4755-a17b-997ba42e5335 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.664794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 789/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:15.665760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.671970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 813/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:15 2022] PUT /identity/v3/projects/abbad2c79d0b4ab785f579ce425c14b7/users/e19e8da2dd5a47abac84aa87cbedb21f/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:15.673520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b116b-e1e3-446e-a60c-24e1bc79accb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.673866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b116b-e1e3-446e-a60c-24e1bc79accb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.674208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b116b-e1e3-446e-a60c-24e1bc79accb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.694054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe588e4-94ff-4490-b3c3-f6fd85317283 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.695963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-376b116b-e1e3-446e-a60c-24e1bc79accb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:15.697896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-376b116b-e1e3-446e-a60c-24e1bc79accb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:15.764338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 814/1603] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:15.765172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b116b-e1e3-446e-a60c-24e1bc79accb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.768963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.769860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:15.770859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.771435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.772385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] PATH_INFO: `/v3/projects/6bfea68771cb40b28877f9f508adadd6/users/08139485025a47b8b34fa9289b472fc4/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.777703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b116b-e1e3-446e-a60c-24e1bc79accb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.784204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.784888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.785238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.785571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.786272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.788298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.789212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfea68771cb40b28877f9f508adadd6, user_id=08139485025a47b8b34fa9289b472fc4, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.792156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.810601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 790/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:15 2022] PUT /identity/v3/projects/6bfea68771cb40b28877f9f508adadd6/users/08139485025a47b8b34fa9289b472fc4/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:15.816594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.821686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 815/1605] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:15 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:15.821686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:15.911719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9062-8123-4064-b006-5a21a435c433 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.917258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:15.931221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d62c0-03f6-4fc3-9392-4ed623f7041f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:15.943049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.944313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.944942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.945687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] PATH_INFO: `/v3/projects/84a6dab05a1248b18e64fdc81c29b1d5/users/73104db15e224f4ba00f9ab79ed46957/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:15.976399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a6dab05a1248b18e64fdc81c29b1d5, user_id=73104db15e224f4ba00f9ab79ed46957, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:15.980407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:15.991692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47cee8-ca42-4734-8a77-50006a01cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:15.992334 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47cee8-ca42-4734-8a77-50006a01cfe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:15.992649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47cee8-ca42-4734-8a77-50006a01cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:15.993008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47cee8-ca42-4734-8a77-50006a01cfe9 admin admin] PATH_INFO: `/v3/projects/2d97154f9c064dbb9f99b6f13bcfc4f6/users/25159fc1c4d1407786ddc60e1503e47b/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.004306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 816/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:15 2022] PUT /identity/v3/projects/84a6dab05a1248b18e64fdc81c29b1d5/users/73104db15e224f4ba00f9ab79ed46957/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:16.009556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:16.017098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47cee8-ca42-4734-8a77-50006a01cfe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d97154f9c064dbb9f99b6f13bcfc4f6, user_id=25159fc1c4d1407786ddc60e1503e47b, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.020889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47cee8-ca42-4734-8a77-50006a01cfe9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:16.042108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 791/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:15 2022] PUT /identity/v3/projects/2d97154f9c064dbb9f99b6f13bcfc4f6/users/25159fc1c4d1407786ddc60e1503e47b/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:16.044395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.044837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.045239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.085057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] MFA Rules not processed for user `e19e8da2dd5a47abac84aa87cbedb21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:16.087528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:16.090129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bf58d-bb92-4be1-8973-be58471d2ec3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:16.171690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:16.172600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.172919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.173348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] PATH_INFO: `/v3/projects/f1080ec3f4d0454ebd2375efd628ab1f/users/7a9617d57a1c4d06a0c5359a4b1907e2/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.188378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 792/1608] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:16.189234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:16.194257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:16.202400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1080ec3f4d0454ebd2375efd628ab1f, user_id=7a9617d57a1c4d06a0c5359a4b1907e2, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.206687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:16.210651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:16.233120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 817/1609] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:16 2022] PUT /identity/v3/projects/f1080ec3f4d0454ebd2375efd628ab1f/users/7a9617d57a1c4d06a0c5359a4b1907e2/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:16.237497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:16.308565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a5930-e0d0-4217-b60a-32cfb454446f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:16.339595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6485-cf90-49f0-ac44-38682842ffce admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:16.348192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269cc4a-8dd5-4b92-ad58-68f07d38f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:16.348980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269cc4a-8dd5-4b92-ad58-68f07d38f41b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.349299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269cc4a-8dd5-4b92-ad58-68f07d38f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.349650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269cc4a-8dd5-4b92-ad58-68f07d38f41b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.350432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269cc4a-8dd5-4b92-ad58-68f07d38f41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.353001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269cc4a-8dd5-4b92-ad58-68f07d38f41b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:16.365897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:16.389472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 818/1610] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:16.392030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dad67-e17f-4632-a1a5-a8e53e5e5bc5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.393308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dad67-e17f-4632-a1a5-a8e53e5e5bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.393606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dad67-e17f-4632-a1a5-a8e53e5e5bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.401023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ac61b-b1e1-43aa-8024-57591003ec6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:16.402642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac61b-b1e1-43aa-8024-57591003ec6a service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.403256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac61b-b1e1-43aa-8024-57591003ec6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.404261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac61b-b1e1-43aa-8024-57591003ec6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.419233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ac61b-b1e1-43aa-8024-57591003ec6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.421000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ac61b-b1e1-43aa-8024-57591003ec6a service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:16.432948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 793/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:16.435485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396fbc-bb59-4697-bc5f-4902d04f8588 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.436676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396fbc-bb59-4697-bc5f-4902d04f8588 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.436676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396fbc-bb59-4697-bc5f-4902d04f8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.436892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8a4dad67-e17f-4632-a1a5-a8e53e5e5bc5 None None] MFA Rules not processed for user `08139485025a47b8b34fa9289b472fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:16.438340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8a4dad67-e17f-4632-a1a5-a8e53e5e5bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:16.466976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-76396fbc-bb59-4697-bc5f-4902d04f8588 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:16.468773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-76396fbc-bb59-4697-bc5f-4902d04f8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:16.482098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 794/1612] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:16.483269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adefb8-624a-449b-8e4e-7a23a2730e3d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.483693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adefb8-624a-449b-8e4e-7a23a2730e3d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.483977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adefb8-624a-449b-8e4e-7a23a2730e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.522055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-92adefb8-624a-449b-8e4e-7a23a2730e3d None None] MFA Rules not processed for user `25159fc1c4d1407786ddc60e1503e47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:16.524551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-92adefb8-624a-449b-8e4e-7a23a2730e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:16.532649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 819/1613] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:16.534796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd7e8c-0970-42f6-881b-8e63c8387a55 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.535528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd7e8c-0970-42f6-881b-8e63c8387a55 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.536065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd7e8c-0970-42f6-881b-8e63c8387a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.608711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-14bd7e8c-0970-42f6-881b-8e63c8387a55 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:16.613198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 795/1614] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:16.614729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c0a4-d70a-4120-bb30-e6f0be978f46 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.615020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c0a4-d70a-4120-bb30-e6f0be978f46 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.615347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c0a4-d70a-4120-bb30-e6f0be978f46 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.616729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-14bd7e8c-0970-42f6-881b-8e63c8387a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:16.617307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 796/1615] 10.222.0.18 () {54 vars in 962 bytes} [Tue Sep 6 04:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:16.617728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214c0a4-d70a-4120-bb30-e6f0be978f46 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:16.639499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214c0a4-d70a-4120-bb30-e6f0be978f46 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:16.647406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 820/1616] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:16.648849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd7e8c-0970-42f6-881b-8e63c8387a55 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:16.653876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b74c-4d87-4821-ad3a-012daf362400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:16.654774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b74c-4d87-4821-ad3a-012daf362400 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.656379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b74c-4d87-4821-ad3a-012daf362400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.656829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b74c-4d87-4821-ad3a-012daf362400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.658402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b74c-4d87-4821-ad3a-012daf362400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.660481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b74c-4d87-4821-ad3a-012daf362400 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:16.663293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd7e8c-0970-42f6-881b-8e63c8387a55 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:16.667877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63173814-2e6c-407b-84e6-b58103c1b313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:16.668700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63173814-2e6c-407b-84e6-b58103c1b313 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.669835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63173814-2e6c-407b-84e6-b58103c1b313 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.670334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63173814-2e6c-407b-84e6-b58103c1b313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.678741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 797/1617] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:16.680256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6c63b-d630-4463-95db-78e339a02c8e None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.680534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6c63b-d630-4463-95db-78e339a02c8e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.680806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6c63b-d630-4463-95db-78e339a02c8e None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.683575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 798/1618] 10.222.0.18 () {54 vars in 962 bytes} [Tue Sep 6 04:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:16.684414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6c63b-d630-4463-95db-78e339a02c8e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:16.702121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63173814-2e6c-407b-84e6-b58103c1b313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.703861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63173814-2e6c-407b-84e6-b58103c1b313 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:16.726308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6c63b-d630-4463-95db-78e339a02c8e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:16.734920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 821/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:16.735197 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:16.736418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf14419-509e-4248-83b1-ccf92674055f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.740555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.740769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf14419-509e-4248-83b1-ccf92674055f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.740890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.741236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf14419-509e-4248-83b1-ccf92674055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.741354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.742058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.744635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:16.803912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 799/1620] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:16.804833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:16.832391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fdf14419-509e-4248-83b1-ccf92674055f None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:16.834044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdf14419-509e-4248-83b1-ccf92674055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:16.897277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:16.918595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cbafd-4769-4cd1-8310-10c0cbd22121 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:16.933954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:16.935163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.935504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.935780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] PATH_INFO: `/v3/projects/a8d22c1090a34ca98726308129d0e3d2/users/8221e4eb50a44e4583ca340d8c2f2432/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.959814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 822/1621] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:16.962354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60902e75-9497-4b73-8b8d-049b2e1d58a8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:16.962709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60902e75-9497-4b73-8b8d-049b2e1d58a8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:16.963680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60902e75-9497-4b73-8b8d-049b2e1d58a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:16.974783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d22c1090a34ca98726308129d0e3d2, user_id=8221e4eb50a44e4583ca340d8c2f2432, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:16.987027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.001136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-60902e75-9497-4b73-8b8d-049b2e1d58a8 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:17.007988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-60902e75-9497-4b73-8b8d-049b2e1d58a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:17.014499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 800/1622] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:16 2022] PUT /identity/v3/projects/a8d22c1090a34ca98726308129d0e3d2/users/8221e4eb50a44e4583ca340d8c2f2432/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:17.015776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.036967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:17.128185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25edc5-dc85-4207-a732-a362dbc91ce5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.140985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.142419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.142749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.143021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.250229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 823/1623] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Sep 6 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:17.251286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60902e75-9497-4b73-8b8d-049b2e1d58a8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.266920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.268994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.285264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 801/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:17.286206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.303174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60902e75-9497-4b73-8b8d-049b2e1d58a8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.307022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8dfa5-9884-49c3-83d8-ff0bb60bbdd7 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.317535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.318271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.318537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.318686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.318871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.319612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.320033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.320465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.322502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.324671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.392422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 824/1625] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:17 2022] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:17.393564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.422904 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145da35-2bf9-4097-9fe7-6d99caaa630f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.430627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.431305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.431650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.432686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.434216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.437683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.461797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.465024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.466605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 825/1626] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:17.467091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.486357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 802/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:17.489578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.506270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e304a-7df9-412c-94ab-24016ba968db admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.514000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a214f-fd1d-4246-a8eb-beccebb0efda service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.521874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ace33-ae55-4db2-b605-d14a40fa01ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.524563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ace33-ae55-4db2-b605-d14a40fa01ed service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.524876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ace33-ae55-4db2-b605-d14a40fa01ed service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.525211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ace33-ae55-4db2-b605-d14a40fa01ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.526017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.526736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.527117 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.528816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.529672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.533727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.560260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 803/1628] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:17.563169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.574783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52eec-d01e-4609-8876-0b6e6d5e0309 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.579773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.580500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.581318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.581521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] PATH_INFO: `/v3/projects/a8d22c1090a34ca98726308129d0e3d2/users/8221e4eb50a44e4583ca340d8c2f2432/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.584726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d22c1090a34ca98726308129d0e3d2, user_id=8221e4eb50a44e4583ca340d8c2f2432, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.588491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.602585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 804/1629] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:17 2022] PUT /identity/v3/projects/a8d22c1090a34ca98726308129d0e3d2/users/8221e4eb50a44e4583ca340d8c2f2432/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:17.603681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.656290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:17.678075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ace33-ae55-4db2-b605-d14a40fa01ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.681656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ace33-ae55-4db2-b605-d14a40fa01ed service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.688160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc709c1-34c7-4e54-8ced-c0ff19d3cea4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.694626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.695716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.696273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.697054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] PATH_INFO: `/v3/projects/84347dd783c34d9086c8adde324d3527/users/689ae6870a714f089dcb1c423e81c921/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.716505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84347dd783c34d9086c8adde324d3527, user_id=689ae6870a714f089dcb1c423e81c921, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.719874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.722119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 826/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:17.724307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df276-24a3-480b-aa64-04c1b34245a5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.724601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df276-24a3-480b-aa64-04c1b34245a5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.724878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df276-24a3-480b-aa64-04c1b34245a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.752744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 805/1631] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:17 2022] PUT /identity/v3/projects/84347dd783c34d9086c8adde324d3527/users/689ae6870a714f089dcb1c423e81c921/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:17.758081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:17.769866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-371df276-24a3-480b-aa64-04c1b34245a5 None None] MFA Rules not processed for user `8221e4eb50a44e4583ca340d8c2f2432`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:17.771590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-371df276-24a3-480b-aa64-04c1b34245a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:17.818980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:17.929548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d53e58-8331-4d50-8bab-6f467ff8d143 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:17.936665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:17.937576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:17.948609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:17.949641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:17.952128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:17.958997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:17.965238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 827/1632] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:17.974325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df276-24a3-480b-aa64-04c1b34245a5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:18.012518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 806/1633] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:18.014464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:18.039269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d1270-5268-4f74-96cb-8cdef4db50cf admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:18.053351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeb035-3d79-4dda-a635-b6cf7c5f973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:18.056386 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeb035-3d79-4dda-a635-b6cf7c5f973f admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.058326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeb035-3d79-4dda-a635-b6cf7c5f973f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.058829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeb035-3d79-4dda-a635-b6cf7c5f973f admin admin] PATH_INFO: `/v3/projects/84347dd783c34d9086c8adde324d3527/users/689ae6870a714f089dcb1c423e81c921/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.065770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeb035-3d79-4dda-a635-b6cf7c5f973f admin admin] RBAC: Authorizing `identity:create_grant(project_id=84347dd783c34d9086c8adde324d3527, user_id=689ae6870a714f089dcb1c423e81c921, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:18.073470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeb035-3d79-4dda-a635-b6cf7c5f973f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:18.100905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 807/1634] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:18 2022] PUT /identity/v3/projects/84347dd783c34d9086c8adde324d3527/users/689ae6870a714f089dcb1c423e81c921/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:18.117890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28222b0-a4a1-4ee7-9694-f7adb07a1163 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.118181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28222b0-a4a1-4ee7-9694-f7adb07a1163 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.118457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28222b0-a4a1-4ee7-9694-f7adb07a1163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.142845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df276-24a3-480b-aa64-04c1b34245a5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:18.207780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b28222b0-a4a1-4ee7-9694-f7adb07a1163 None None] MFA Rules not processed for user `689ae6870a714f089dcb1c423e81c921`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:18.210316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b28222b0-a4a1-4ee7-9694-f7adb07a1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:18.235121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71207f0e-3345-45ba-bb51-a23cc1c70ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:18.236367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71207f0e-3345-45ba-bb51-a23cc1c70ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.236659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71207f0e-3345-45ba-bb51-a23cc1c70ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.237790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71207f0e-3345-45ba-bb51-a23cc1c70ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.377410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 808/1635] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:18.379756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eb794-a72f-4d6c-885a-0aba827f8d38 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.382988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eb794-a72f-4d6c-885a-0aba827f8d38 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.383628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eb794-a72f-4d6c-885a-0aba827f8d38 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.386094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 809/1636] 10.222.0.18 () {54 vars in 912 bytes} [Tue Sep 6 04:22:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:18.393601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7825e-1bc0-45d4-9dd7-d3921f63fea3 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.394365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7825e-1bc0-45d4-9dd7-d3921f63fea3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.395406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71207f0e-3345-45ba-bb51-a23cc1c70ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:18.396773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7825e-1bc0-45d4-9dd7-d3921f63fea3 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.397702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71207f0e-3345-45ba-bb51-a23cc1c70ac0 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:18.404015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 810/1637] 10.222.0.18 () {54 vars in 912 bytes} [Tue Sep 6 04:22:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:18.405110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7825e-1bc0-45d4-9dd7-d3921f63fea3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:18.423393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 828/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:18.426378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b44e0f-cca2-4013-a225-74b4e3b2d3d5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.427950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b44e0f-cca2-4013-a225-74b4e3b2d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.428835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b44e0f-cca2-4013-a225-74b4e3b2d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.429979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7825e-1bc0-45d4-9dd7-d3921f63fea3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:18.440066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4976f-e936-46b8-b0c0-480dc6278384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:18.441134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4976f-e936-46b8-b0c0-480dc6278384 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.442368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4976f-e936-46b8-b0c0-480dc6278384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.443404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4976f-e936-46b8-b0c0-480dc6278384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.473318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4976f-e936-46b8-b0c0-480dc6278384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:18.475518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4976f-e936-46b8-b0c0-480dc6278384 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:18.486085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-23b44e0f-cca2-4013-a225-74b4e3b2d3d5 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:18.489241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-23b44e0f-cca2-4013-a225-74b4e3b2d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:18.502601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 811/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:18.503940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d132-15cb-447a-9136-7a3446ec1a86 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.504226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d132-15cb-447a-9136-7a3446ec1a86 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.504502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d132-15cb-447a-9136-7a3446ec1a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.533123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:18.554250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9bb9d132-15cb-447a-9136-7a3446ec1a86 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:18.555574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9bb9d132-15cb-447a-9136-7a3446ec1a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:18.597128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:18.735216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 829/1640] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:22:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:18.736973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b44e0f-cca2-4013-a225-74b4e3b2d3d5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:18.771367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b44e0f-cca2-4013-a225-74b4e3b2d3d5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:18.777970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:18.778942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.780493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.780956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.816085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 812/1641] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:22:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:18.817641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d132-15cb-447a-9136-7a3446ec1a86 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:18.841211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d132-15cb-447a-9136-7a3446ec1a86 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:18.860212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:18.860879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:18.861160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:18.861431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:18.879590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:18.881132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:18.909045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 813/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:18.909863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:18.925949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:18.928426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:18.945041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 830/1643] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:19.070134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944dc0c-cc9f-43dc-9fe0-8ffd45f3807c service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:19.082086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:19.083231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:19.083643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:19.084016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] PATH_INFO: `/v3/users/25159fc1c4d1407786ddc60e1503e47b` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:19.087904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=25159fc1c4d1407786ddc60e1503e47b)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:19.089266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: WARNING py.warnings [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:22:19.089266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: warnings.warn(msg) Sep 06 04:22:19.089266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: Sep 06 04:22:19.091662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:19.232239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25159fc1c4d1407786ddc60e1503e47b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:19.256141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25159fc1c4d1407786ddc60e1503e47b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:19.300195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25159fc1c4d1407786ddc60e1503e47b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:19.303366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25159fc1c4d1407786ddc60e1503e47b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:19.304261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-889f9209-1fe1-43c3-8dee-81ee84a9b4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25159fc1c4d1407786ddc60e1503e47b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:19.348672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 814/1644] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:18 2022] DELETE /identity/v3/users/25159fc1c4d1407786ddc60e1503e47b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:19.348848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:19.350510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:19.350510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:19.350755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:19.361780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ebb8-86ff-4e50-acc8-305531240b91 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:19.391320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:19.393770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:19.418262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:19.533725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 815/1645] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:19.559788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:19.561419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:19.563268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:19.566333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:19.567069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:19.567364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:19.570254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:19.697135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b65faa-6c29-469d-b832-05379e1cd3e9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:19.711099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:19.711926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:19.712316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:19.712743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:19.737543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:19.740989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:19.763354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 816/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:22:19.801784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:19.804824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:19.816784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:19.855826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 831/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:22:21.265286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:21.267694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:21.309658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fd3a5-8d5c-4c07-9f6d-1bc46be7fda2 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:21.315351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:21.316299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:21.316779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:21.317263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] PATH_INFO: `/v3/projects/2d97154f9c064dbb9f99b6f13bcfc4f6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:21.318598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d97154f9c064dbb9f99b6f13bcfc4f6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:21.320787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:21.429189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d97154f9c064dbb9f99b6f13bcfc4f6', 'request_id': 'req-82c395ff-2386-478b-9e97-0d2d00875e7b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.448208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d97154f9c064dbb9f99b6f13bcfc4f6', 'request_id': 'req-82c395ff-2386-478b-9e97-0d2d00875e7b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.460893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d97154f9c064dbb9f99b6f13bcfc4f6', 'request_id': 'req-82c395ff-2386-478b-9e97-0d2d00875e7b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.488729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] The token cache is being invalidate because project 2d97154f9c064dbb9f99b6f13bcfc4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:21.489180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.489989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.493349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 817/1648] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:21 2022] DELETE /identity/v3/projects/2d97154f9c064dbb9f99b6f13bcfc4f6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:21.498206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:21.513210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fab2e-655d-478d-b40b-11ef921ac8f5 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:21.663395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:21.663972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:21.664253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:21.664670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] PATH_INFO: `/v3/users/689ae6870a714f089dcb1c423e81c921` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:21.665858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=689ae6870a714f089dcb1c423e81c921)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:21.668041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:21.769957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689ae6870a714f089dcb1c423e81c921'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.790644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689ae6870a714f089dcb1c423e81c921'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.821962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689ae6870a714f089dcb1c423e81c921'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.825188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689ae6870a714f089dcb1c423e81c921'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.826466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2843019c-86d3-4d62-bf42-f94287063099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689ae6870a714f089dcb1c423e81c921'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:21.858780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 832/1649] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:21 2022] DELETE /identity/v3/users/689ae6870a714f089dcb1c423e81c921 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:23.957587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:23.959014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:23.981738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c395ff-2386-478b-9e97-0d2d00875e7b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:24.065158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:24.100107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:24.101276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:24.101567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:24.101854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] PATH_INFO: `/v3/users/08139485025a47b8b34fa9289b472fc4` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:24.103089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=08139485025a47b8b34fa9289b472fc4)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:24.106104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:24.253968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08139485025a47b8b34fa9289b472fc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:24.286588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08139485025a47b8b34fa9289b472fc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:24.317387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08139485025a47b8b34fa9289b472fc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:24.317989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08139485025a47b8b34fa9289b472fc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:24.318628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08139485025a47b8b34fa9289b472fc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:24.343801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 818/1650] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:23 2022] DELETE /identity/v3/users/08139485025a47b8b34fa9289b472fc4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:24.345460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:24.345939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:24.346010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:24.394830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:24.402079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:24.603413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 833/1651] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:24.716640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:24.718131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:24.912698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfcd2a-1d0c-4c4c-b23f-77f478ebd0ee admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:24.924274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8729045-29da-4e81-9db7-943650b3967c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:24.925208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729045-29da-4e81-9db7-943650b3967c service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:24.925208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729045-29da-4e81-9db7-943650b3967c service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:24.925426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729045-29da-4e81-9db7-943650b3967c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:24.975660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729045-29da-4e81-9db7-943650b3967c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:24.977529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729045-29da-4e81-9db7-943650b3967c service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:25.035520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 819/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:25.081482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:25.083975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:25.118917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd030-0caf-41cf-9d46-e01128349988 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:25.134338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:25.135005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:25.135286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:25.135614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] PATH_INFO: `/v3/projects/84347dd783c34d9086c8adde324d3527` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:25.136863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84347dd783c34d9086c8adde324d3527)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:25.138112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 04:22:25.138112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 06 04:22:25.138112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: Sep 06 04:22:25.139394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:25.160796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:25.312316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84347dd783c34d9086c8adde324d3527', 'request_id': 'req-18b02571-e9e6-4a43-8744-883c4360b222'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:25.334016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84347dd783c34d9086c8adde324d3527', 'request_id': 'req-18b02571-e9e6-4a43-8744-883c4360b222'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:25.363160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84347dd783c34d9086c8adde324d3527', 'request_id': 'req-18b02571-e9e6-4a43-8744-883c4360b222'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:25.433599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] The token cache is being invalidate because project 84347dd783c34d9086c8adde324d3527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:25.433889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:25.434635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-18b02571-e9e6-4a43-8744-883c4360b222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:25.439713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 834/1653] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:25 2022] DELETE /identity/v3/projects/84347dd783c34d9086c8adde324d3527 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:25.441339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e517f7-f818-4b00-8154-b7dca16af003 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:25.441740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e517f7-f818-4b00-8154-b7dca16af003 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:25.442132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e517f7-f818-4b00-8154-b7dca16af003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:25.473223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-59e517f7-f818-4b00-8154-b7dca16af003 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:25.475450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-59e517f7-f818-4b00-8154-b7dca16af003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:25.632383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 820/1654] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:25.642846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb44d63-0f96-4114-b9e0-2ac23c86d4f9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:25.643501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb44d63-0f96-4114-b9e0-2ac23c86d4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:25.645016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb44d63-0f96-4114-b9e0-2ac23c86d4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:25.687203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-aeb44d63-0f96-4114-b9e0-2ac23c86d4f9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:25.688571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aeb44d63-0f96-4114-b9e0-2ac23c86d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:25.716380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 835/1655] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:25.717832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e517f7-f818-4b00-8154-b7dca16af003 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:25.722822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:25.732689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e517f7-f818-4b00-8154-b7dca16af003 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:25.749285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:25.750213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:25.759203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:25.759667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:25.760378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:25.760689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:25.762902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:25.810904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 821/1656] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:25.813259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb44d63-0f96-4114-b9e0-2ac23c86d4f9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:25.850482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb44d63-0f96-4114-b9e0-2ac23c86d4f9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:25.868128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:25.869290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:25.869736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:25.870221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:25.871082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:25.877390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:25.964458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 836/1657] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:25 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:25.966058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:25.986552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c349-96bd-4868-b333-e4c8dd50edf1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:26.027177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:26.028984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:26.128846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29968-da3d-4dcf-9634-6927d982aa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:26.129465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29968-da3d-4dcf-9634-6927d982aa74 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:26.129746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29968-da3d-4dcf-9634-6927d982aa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:26.130021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29968-da3d-4dcf-9634-6927d982aa74 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:26.130667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c29968-da3d-4dcf-9634-6927d982aa74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:26.132681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c29968-da3d-4dcf-9634-6927d982aa74 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:26.208270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360ad9-612a-4e05-ae83-72e57514ee92 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:26.230947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:26.231528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:26.231975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:26.232395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] PATH_INFO: `/v3/users/e19e8da2dd5a47abac84aa87cbedb21f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:26.233815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19e8da2dd5a47abac84aa87cbedb21f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:26.236178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:26.239043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 822/1658] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:25 2022] POST /identity/v3/users => generated 282 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:26.242257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb5591-88d2-4f98-9dbf-767502104f90 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:26.242871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb5591-88d2-4f98-9dbf-767502104f90 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:26.244461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb5591-88d2-4f98-9dbf-767502104f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:26.290621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-4ebb5591-88d2-4f98-9dbf-767502104f90 None None] MFA Rules not processed for user `208fda1fb75d43729d8eef8c89f8cd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:26.292613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4ebb5591-88d2-4f98-9dbf-767502104f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:26.350128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19e8da2dd5a47abac84aa87cbedb21f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:26.384071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19e8da2dd5a47abac84aa87cbedb21f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:26.403603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:26.405291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19e8da2dd5a47abac84aa87cbedb21f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:26.406358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19e8da2dd5a47abac84aa87cbedb21f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:26.407214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19e8da2dd5a47abac84aa87cbedb21f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:26.431213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 837/1659] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:26 2022] DELETE /identity/v3/users/e19e8da2dd5a47abac84aa87cbedb21f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:22:26.432329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:26.436522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:26.479742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 823/1660] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:26.481806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256f48-d66a-4551-a131-8086bfb00b51 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:26.482018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256f48-d66a-4551-a131-8086bfb00b51 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:26.482295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256f48-d66a-4551-a131-8086bfb00b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:26.529760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-22256f48-d66a-4551-a131-8086bfb00b51 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:26.532727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-22256f48-d66a-4551-a131-8086bfb00b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:26.627603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81de7-32d4-40b9-8f0e-10216baef510 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:26.658167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25466019-665d-4d64-98a8-542b05dd2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:26.659366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25466019-665d-4d64-98a8-542b05dd2dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:26.660403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25466019-665d-4d64-98a8-542b05dd2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:26.661532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25466019-665d-4d64-98a8-542b05dd2dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:26.666676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25466019-665d-4d64-98a8-542b05dd2dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:26.678729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25466019-665d-4d64-98a8-542b05dd2dcc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:26.730684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 838/1661] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:26.737462 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efd885-16ed-449e-af3f-fc28dfce15f4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:26.739594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efd885-16ed-449e-af3f-fc28dfce15f4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:26.741199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efd885-16ed-449e-af3f-fc28dfce15f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:26.763791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 824/1662] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:26.765090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22256f48-d66a-4551-a131-8086bfb00b51 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:26.811716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22256f48-d66a-4551-a131-8086bfb00b51 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:26.825845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-00efd885-16ed-449e-af3f-fc28dfce15f4 None None] MFA Rules not processed for user `208fda1fb75d43729d8eef8c89f8cd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:26.827579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-00efd885-16ed-449e-af3f-fc28dfce15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:26.829944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:26.830902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:26.831138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:26.831432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:26.832090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:26.834936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:26.841773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:26.864575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 825/1663] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:26.870257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:26.876243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:27.002524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 839/1664] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:27.003473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efd885-16ed-449e-af3f-fc28dfce15f4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:27.037008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efd885-16ed-449e-af3f-fc28dfce15f4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:27.059243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:27.059969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:27.060247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:27.060515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] PATH_INFO: `/v3/projects/4a794bde3a424fc190b56a0725f967ac/users/c2e49c875a5247b5be8e5b9f9f8ed824/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:27.081175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1c33-4134-4112-8680-d5031a3d46eb admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:27.092496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:27.094340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:27.094819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:27.095672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:27.100284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a794bde3a424fc190b56a0725f967ac, user_id=c2e49c875a5247b5be8e5b9f9f8ed824, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:27.110264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:27.110974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:27.113353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:27.136132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 826/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:27.143319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:27.149514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:27.149657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 840/1666] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:27 2022] PUT /identity/v3/projects/4a794bde3a424fc190b56a0725f967ac/users/c2e49c875a5247b5be8e5b9f9f8ed824/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:27.152272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:27.157387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:27.331970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e7d0b-2fc7-44a5-bf9c-0ee41fedebf0 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:27.333391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117edb-1072-44b7-993d-1306e0d4c5b1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:27.345917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:27.348734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:27.348922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:27.349324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] PATH_INFO: `/v3/projects/6bfea68771cb40b28877f9f508adadd6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:27.355062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfea68771cb40b28877f9f508adadd6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:27.358344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:27.378492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:27.506592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfea68771cb40b28877f9f508adadd6', 'request_id': 'req-0a1edc15-758a-4c62-a2d0-eb16365466db'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:27.513155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9807-b455-46ef-affb-935d98ae04d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:27.514614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9807-b455-46ef-affb-935d98ae04d7 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:27.515087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9807-b455-46ef-affb-935d98ae04d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:27.516659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9807-b455-46ef-affb-935d98ae04d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:27.529936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfea68771cb40b28877f9f508adadd6', 'request_id': 'req-0a1edc15-758a-4c62-a2d0-eb16365466db'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:27.552006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfea68771cb40b28877f9f508adadd6', 'request_id': 'req-0a1edc15-758a-4c62-a2d0-eb16365466db'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:27.583965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] The token cache is being invalidate because project 6bfea68771cb40b28877f9f508adadd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:27.584339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:27.585117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a1edc15-758a-4c62-a2d0-eb16365466db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:27.592119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 841/1667] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:27 2022] DELETE /identity/v3/projects/6bfea68771cb40b28877f9f508adadd6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:27.593648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:27.597282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:27.597680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:27.603234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:27.638719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9807-b455-46ef-affb-935d98ae04d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:27.641154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9807-b455-46ef-affb-935d98ae04d7 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:27.657067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 827/1668] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:27.659486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:27.659974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:27.660500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:27.669329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] MFA Rules not processed for user `c2e49c875a5247b5be8e5b9f9f8ed824`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:27.673433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:27.687345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:27.688929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:27.856398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 842/1669] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:27.858240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:27.860136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:27.880040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 828/1670] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:27.880906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:27.882580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:27.900203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d92bd-2bbb-42e9-bfd4-b492a127f366 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:27.913293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106005e9-c680-4cb1-8490-d97ac4bac249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:27.913946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106005e9-c680-4cb1-8490-d97ac4bac249 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:27.914405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106005e9-c680-4cb1-8490-d97ac4bac249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:27.914681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106005e9-c680-4cb1-8490-d97ac4bac249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:27.916924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106005e9-c680-4cb1-8490-d97ac4bac249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:27.920119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106005e9-c680-4cb1-8490-d97ac4bac249 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.033898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 829/1671] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:27 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:28.034204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84926063-37ea-4d44-abc9-1f966f831050 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.037876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01624e18-0e7d-48c8-ba63-690a31e20bed None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.058185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01624e18-0e7d-48c8-ba63-690a31e20bed None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.060712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01624e18-0e7d-48c8-ba63-690a31e20bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.116326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:28.184466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-01624e18-0e7d-48c8-ba63-690a31e20bed None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:28.187432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-01624e18-0e7d-48c8-ba63-690a31e20bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:28.196064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.196714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.196987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.197260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] PATH_INFO: `/v3/projects/abbad2c79d0b4ab785f579ce425c14b7` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.200601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbad2c79d0b4ab785f579ce425c14b7)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.203397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.215960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 830/1672] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:28.221806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01624e18-0e7d-48c8-ba63-690a31e20bed None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.252456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01624e18-0e7d-48c8-ba63-690a31e20bed None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.271188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.272238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.273684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.274065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.276227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.286874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.352544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 831/1673] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:28 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:28.353883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbad2c79d0b4ab785f579ce425c14b7', 'request_id': 'req-26577066-df71-405d-bc7c-47d964e87d54'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:28.357181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.368044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbad2c79d0b4ab785f579ce425c14b7', 'request_id': 'req-26577066-df71-405d-bc7c-47d964e87d54'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:28.377428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbad2c79d0b4ab785f579ce425c14b7', 'request_id': 'req-26577066-df71-405d-bc7c-47d964e87d54'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:28.393585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b503150-537a-4b0c-be1d-173ee1bf7c0e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.397531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] The token cache is being invalidate because project abbad2c79d0b4ab785f579ce425c14b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:28.399587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:28.401192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:28.403276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 843/1674] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:27 2022] DELETE /identity/v3/projects/abbad2c79d0b4ab785f579ce425c14b7 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:28.404636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.407135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:28.498545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577066-df71-405d-bc7c-47d964e87d54 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.505157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42a78f-63ce-4e58-a442-e647acf6c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.505827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a78f-63ce-4e58-a442-e647acf6c97a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.506401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a78f-63ce-4e58-a442-e647acf6c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.506779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a78f-63ce-4e58-a442-e647acf6c97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.507871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42a78f-63ce-4e58-a442-e647acf6c97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.510759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42a78f-63ce-4e58-a442-e647acf6c97a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.529037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 844/1675] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:28.531260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa50a2-45c5-46ec-a2c0-38513f1c70cc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.531573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa50a2-45c5-46ec-a2c0-38513f1c70cc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.532005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa50a2-45c5-46ec-a2c0-38513f1c70cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.557797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.558636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.559061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.562406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.563225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:28.563675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.565596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.579192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-30aa50a2-45c5-46ec-a2c0-38513f1c70cc None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:28.580582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-30aa50a2-45c5-46ec-a2c0-38513f1c70cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:28.602389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 832/1677] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:28.602614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 845/1677] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:28.602711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.606360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.606819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.608946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.618211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2e58-12ac-4bfa-9a8d-ab2a11264cd0 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.629912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.631526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.631926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.633004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] PATH_INFO: `/v3/projects/1cefaba5b1654d8ea05601099e1f7420/users/e61406db88ea43b1a8368c833ad7fcc8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.656172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:28.658593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:28.673991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cefaba5b1654d8ea05601099e1f7420, user_id=e61406db88ea43b1a8368c833ad7fcc8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.674822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 846/1678] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:28.675983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.678849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:28.682524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.703096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:28.708430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 833/1679] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:28 2022] PUT /identity/v3/projects/1cefaba5b1654d8ea05601099e1f7420/users/e61406db88ea43b1a8368c833ad7fcc8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:28.709384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.719820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc1d4-00af-49d0-ab3e-7daeceb8c934 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.789546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2ad9-3c5e-47be-ac88-d5fd41ba4b40 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.795405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.796201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.796594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.796976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.797751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:28.798189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.800246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.814157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 834/1680] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:28.815106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.827356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e5e42-1019-4875-8ad4-0c3c6c771c95 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.833720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.834055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:28.834615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.835051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.835753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.837485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.838358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.852425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 835/1681] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:28.853443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.865822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56c688-6c8f-480b-9e4d-a01178a1bb87 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:28.871509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.872586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.873368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.873368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.874259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.874469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:28.875148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:28.875446 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:28.875773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:28.876524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:28.876893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.880538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:28.929721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 836/1682] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:28.930817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:28.952564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 847/1683] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:28 2022] POST /identity/v3/projects => generated 367 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:28.953516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.073360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841767-7714-4aea-82ee-959af9b29ec6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.106778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a059-9a94-4a6b-a843-6074b333b5b9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.127392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.128684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.128899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.129284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.130232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.133051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.181043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 848/1684] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:28 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:29.181993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.202996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62316b86-109d-4721-b5ce-8e4f6df09dfc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.209757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ef96-abd6-4865-be2b-5045cb34506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.210959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ef96-abd6-4865-be2b-5045cb34506c admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.211417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ef96-abd6-4865-be2b-5045cb34506c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.211847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ef96-abd6-4865-be2b-5045cb34506c admin admin] PATH_INFO: `/v3/projects/1cefaba5b1654d8ea05601099e1f7420/users/e61406db88ea43b1a8368c833ad7fcc8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.214001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeb5ce-dfdb-4eae-9dad-d77985e4cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.214407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ef96-abd6-4865-be2b-5045cb34506c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cefaba5b1654d8ea05601099e1f7420, user_id=e61406db88ea43b1a8368c833ad7fcc8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.214784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb5ce-dfdb-4eae-9dad-d77985e4cefd admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.215684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb5ce-dfdb-4eae-9dad-d77985e4cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.216028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb5ce-dfdb-4eae-9dad-d77985e4cefd admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.216744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeb5ce-dfdb-4eae-9dad-d77985e4cefd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.218428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ef96-abd6-4865-be2b-5045cb34506c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.228050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeb5ce-dfdb-4eae-9dad-d77985e4cefd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.247025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 837/1685] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:28 2022] PUT /identity/v3/projects/1cefaba5b1654d8ea05601099e1f7420/users/e61406db88ea43b1a8368c833ad7fcc8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:29.248616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55197-9304-449a-8ba4-279cfe438a88 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.249053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55197-9304-449a-8ba4-279cfe438a88 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.249472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55197-9304-449a-8ba4-279cfe438a88 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.250889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 838/1686] 10.222.0.18 () {54 vars in 912 bytes} [Tue Sep 6 04:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:29.251811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55197-9304-449a-8ba4-279cfe438a88 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.265807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:29.300460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 849/1687] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:29 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:29.308109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33ca8-6b68-4a4b-871b-6fa1384e113f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.310735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33ca8-6b68-4a4b-871b-6fa1384e113f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.312323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33ca8-6b68-4a4b-871b-6fa1384e113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.459627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5df33ca8-6b68-4a4b-871b-6fa1384e113f None None] MFA Rules not processed for user `bf28e8b35a8246778b66c59164947add`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:29.462543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5df33ca8-6b68-4a4b-871b-6fa1384e113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:29.493190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55197-9304-449a-8ba4-279cfe438a88 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.508658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1f8a1-2ef7-41f4-afc6-8633adce4b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.509557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f8a1-2ef7-41f4-afc6-8633adce4b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.510003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f8a1-2ef7-41f4-afc6-8633adce4b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.510445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f8a1-2ef7-41f4-afc6-8633adce4b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.511247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1f8a1-2ef7-41f4-afc6-8633adce4b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.518354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1f8a1-2ef7-41f4-afc6-8633adce4b33 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.559891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 839/1688] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:29.561508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd51ec-d9c0-44e1-a265-e398dce7a69d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.564330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd51ec-d9c0-44e1-a265-e398dce7a69d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.565163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd51ec-d9c0-44e1-a265-e398dce7a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.624916 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 850/1689] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:22:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:29.626506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33ca8-6b68-4a4b-871b-6fa1384e113f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.647449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-05cd51ec-d9c0-44e1-a265-e398dce7a69d None None] MFA Rules not processed for user `e61406db88ea43b1a8368c833ad7fcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:29.649133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-05cd51ec-d9c0-44e1-a265-e398dce7a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:29.654488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33ca8-6b68-4a4b-871b-6fa1384e113f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.666083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.668073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.669224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.670552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.671586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.674000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.718846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 851/1690] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:29.720762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.749035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712706-2302-41a7-8131-74545da4dac1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.763001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.763656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.767181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.767574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.770145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.787960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.841826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 852/1691] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:29.841826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.853221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:29.888302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c27870-50cb-48b2-bdb4-5fe6d8d1ebbd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.906363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.912226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 840/1692] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:29.912226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd51ec-d9c0-44e1-a265-e398dce7a69d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.912490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.912490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.912652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.940363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.941831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.957064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd51ec-d9c0-44e1-a265-e398dce7a69d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:29.963961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 853/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:29.966017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:29.972795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:29.975274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:29.977032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:29.977944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:29.987411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:29.987411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:29.996493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c393c-1b9f-4c04-a773-d8f6a185cf41 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:30.000858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:30.015732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:30.016780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:30.017064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:30.017338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] PATH_INFO: `/v3/projects/72b0b4c931494f03907bdc2ed3451be2/users/8ac3bc8219a84cdfa16c0792d28ac20b/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:30.026901 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 841/1694] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:30.035798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:30.042369 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:30.071679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b0b4c931494f03907bdc2ed3451be2, user_id=8ac3bc8219a84cdfa16c0792d28ac20b, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:30.082145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:30.131021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 854/1695] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:29 2022] PUT /identity/v3/projects/72b0b4c931494f03907bdc2ed3451be2/users/8ac3bc8219a84cdfa16c0792d28ac20b/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:30.131688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:30.264759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135e168-7dbb-4ab0-96e9-8016042c195c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:30.295640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3806b9-7010-4bfe-a846-02cfe6e1422b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:30.308719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb3b56-3549-4bfc-9155-3240c19d2241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:30.309965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb3b56-3549-4bfc-9155-3240c19d2241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:30.310246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb3b56-3549-4bfc-9155-3240c19d2241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:30.310519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb3b56-3549-4bfc-9155-3240c19d2241 admin admin] PATH_INFO: `/v3/projects/7ae1c87681a54acaa74b394a71bd13b8/users/d0bccab0a8134a5787ec9251ab9d25de/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:30.349347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb3b56-3549-4bfc-9155-3240c19d2241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae1c87681a54acaa74b394a71bd13b8, user_id=d0bccab0a8134a5787ec9251ab9d25de, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:30.352164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb3b56-3549-4bfc-9155-3240c19d2241 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:30.354358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:30.393679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 855/1696] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:30 2022] PUT /identity/v3/projects/7ae1c87681a54acaa74b394a71bd13b8/users/d0bccab0a8134a5787ec9251ab9d25de/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:30.396726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba77e-6579-4357-b315-8d561698d9f3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:30.397028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba77e-6579-4357-b315-8d561698d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:30.397306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba77e-6579-4357-b315-8d561698d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:30.436324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:30.441552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:30.442973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:30.443504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:30.445937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-087ba77e-6579-4357-b315-8d561698d9f3 None None] MFA Rules not processed for user `8ac3bc8219a84cdfa16c0792d28ac20b`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:30.447250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-087ba77e-6579-4357-b315-8d561698d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:30.597584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 856/1697] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:30.597584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdde4-226f-4190-8dd4-38af68c655d9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:30.597584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdde4-226f-4190-8dd4-38af68c655d9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:30.597584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdde4-226f-4190-8dd4-38af68c655d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:30.647931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f55fdde4-226f-4190-8dd4-38af68c655d9 None None] MFA Rules not processed for user `d0bccab0a8134a5787ec9251ab9d25de`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:30.649230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f55fdde4-226f-4190-8dd4-38af68c655d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:30.649563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:30.651280 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:30.686553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 842/1698] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:30.687736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:30.692989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:30.768510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:30.844251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 857/1699] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:30.858258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdde4-226f-4190-8dd4-38af68c655d9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:30.902997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274997e-86d7-4f87-b33a-052af7a794e9 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:30.975229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdde4-226f-4190-8dd4-38af68c655d9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:30.992240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86663ed-97bf-4b00-9759-3b3b9c480051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:30.992880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86663ed-97bf-4b00-9759-3b3b9c480051 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:31.007570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86663ed-97bf-4b00-9759-3b3b9c480051 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:31.007570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86663ed-97bf-4b00-9759-3b3b9c480051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:31.029320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86663ed-97bf-4b00-9759-3b3b9c480051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:31.031422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86663ed-97bf-4b00-9759-3b3b9c480051 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:31.056218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 858/1700] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:22:31.063761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:31.066709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:31.067018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:31.069824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:31.108413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:31.115016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:31.159013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 843/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:31.163115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e330e-4cfc-4706-b194-2fc7e6342422 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:31.163471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e330e-4cfc-4706-b194-2fc7e6342422 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:31.163766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e330e-4cfc-4706-b194-2fc7e6342422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:31.265992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-631e330e-4cfc-4706-b194-2fc7e6342422 None None] MFA Rules not processed for user `f8f46235d0d34ba5bbb60e675002fc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:31.267118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-631e330e-4cfc-4706-b194-2fc7e6342422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:31.555604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 859/1702] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:31.864516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:31.879227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:31.897409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab60c-3d28-41d8-b8f6-b5423934acda service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:31.925591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:31.926380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:31.938983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:31.938983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:31.969357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:31.981766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:32.059254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 844/1703] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:32.583532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e330e-4cfc-4706-b194-2fc7e6342422 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:32.705916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:32.857198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e330e-4cfc-4706-b194-2fc7e6342422 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:32.873548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:32.874617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:32.875159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:32.875745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] PATH_INFO: `/v3/users/8ac3bc8219a84cdfa16c0792d28ac20b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:32.880509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac3bc8219a84cdfa16c0792d28ac20b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:32.882921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:32.906387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1622a1-c608-41d7-80fb-bcea3683d625 service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:32.922617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:32.926583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:32.929734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:32.932909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:32.934026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] PATH_INFO: `/v3/users/c2e49c875a5247b5be8e5b9f9f8ed824` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:32.943789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e49c875a5247b5be8e5b9f9f8ed824)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:32.950014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:33.011733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac3bc8219a84cdfa16c0792d28ac20b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.033973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac3bc8219a84cdfa16c0792d28ac20b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.089493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac3bc8219a84cdfa16c0792d28ac20b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.092470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e49c875a5247b5be8e5b9f9f8ed824'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.092888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac3bc8219a84cdfa16c0792d28ac20b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.096370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac3bc8219a84cdfa16c0792d28ac20b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.101552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e49c875a5247b5be8e5b9f9f8ed824'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.144759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e49c875a5247b5be8e5b9f9f8ed824'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.149105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e49c875a5247b5be8e5b9f9f8ed824'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.151316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-40473827-03c0-4773-ae8f-3b7db27307eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e49c875a5247b5be8e5b9f9f8ed824'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:33.156540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 860/1704] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:32 2022] DELETE /identity/v3/users/8ac3bc8219a84cdfa16c0792d28ac20b => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:33.159128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:33.168681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:33.177234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 845/1705] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:32 2022] DELETE /identity/v3/users/c2e49c875a5247b5be8e5b9f9f8ed824 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:33.178595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c29638-f1f9-4415-ba1e-0ff8e016b10a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:33.178881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c29638-f1f9-4415-ba1e-0ff8e016b10a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:33.179282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c29638-f1f9-4415-ba1e-0ff8e016b10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:33.235818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-93c29638-f1f9-4415-ba1e-0ff8e016b10a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:33.237107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-93c29638-f1f9-4415-ba1e-0ff8e016b10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:33.409498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 846/1706] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:33.410809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666468-77d9-4a12-b43c-45b796a152fc None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:33.411097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666468-77d9-4a12-b43c-45b796a152fc None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:33.411387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666468-77d9-4a12-b43c-45b796a152fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:33.463811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d1666468-77d9-4a12-b43c-45b796a152fc None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:33.465632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d1666468-77d9-4a12-b43c-45b796a152fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:33.492392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322415ab-ba0e-4891-b573-0685bdd3cf3f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:33.516636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 847/1707] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:33.518043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a2c3-ad32-4b0f-9fca-3a3bcbb83d96 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:33.518330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a2c3-ad32-4b0f-9fca-3a3bcbb83d96 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:33.518607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a2c3-ad32-4b0f-9fca-3a3bcbb83d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:33.550666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:33.574363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9f30a2c3-ad32-4b0f-9fca-3a3bcbb83d96 None None] MFA Rules not processed for user `208fda1fb75d43729d8eef8c89f8cd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:33.575844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9f30a2c3-ad32-4b0f-9fca-3a3bcbb83d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:33.684034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:33.685373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:33.685879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:33.686350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:33.691211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:33.723174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:33.725011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:33.751891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 848/1708] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:33.753114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:33.753399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:33.753675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:33.777832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 861/1709] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:33.778847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:33.784860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:33.844615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] MFA Rules not processed for user `73104db15e224f4ba00f9ab79ed46957`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:33.848734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:34.005933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:34.058414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 849/1710] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:34.060967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:34.071770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:34.134154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5076c-9ed3-4f48-b148-b1d75036958e service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:34.168953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:34.170028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:34.170447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:34.171932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:34.208087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:34.217152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:34.225367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed593e-b0f0-47ef-b80d-e4a8417c872e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:34.242885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a236-5b9d-4b8c-98de-a6fb30fe0df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:34.244597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a236-5b9d-4b8c-98de-a6fb30fe0df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:34.245059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a236-5b9d-4b8c-98de-a6fb30fe0df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:34.245492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a236-5b9d-4b8c-98de-a6fb30fe0df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:34.271612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a236-5b9d-4b8c-98de-a6fb30fe0df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:34.273092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a236-5b9d-4b8c-98de-a6fb30fe0df4 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:34.308096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 862/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:34.309899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 850/1712] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:34.313268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:34.323739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:34.522062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac20e-0dd1-4aed-b691-097e6a61b6f5 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:34.522646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac20e-0dd1-4aed-b691-097e6a61b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:34.523421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac20e-0dd1-4aed-b691-097e6a61b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:34.624027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-13fac20e-0dd1-4aed-b691-097e6a61b6f5 None None] MFA Rules not processed for user `7a9617d57a1c4d06a0c5359a4b1907e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:34.625366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-13fac20e-0dd1-4aed-b691-097e6a61b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:34.718803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e2334-14d6-4b2d-8dce-5e0033f21c71 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:34.732243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f67dc-0cce-4c2f-97f0-eb942bc2c801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:34.733425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f67dc-0cce-4c2f-97f0-eb942bc2c801 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:34.733820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f67dc-0cce-4c2f-97f0-eb942bc2c801 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:34.734239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f67dc-0cce-4c2f-97f0-eb942bc2c801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:34.748272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:34.758498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f67dc-0cce-4c2f-97f0-eb942bc2c801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:34.763483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f67dc-0cce-4c2f-97f0-eb942bc2c801 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:34.821488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 863/1713] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:34.917349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 851/1714] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:34.924300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78e6cc-8b0d-4506-a45e-0c634fa357fe None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:34.924710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78e6cc-8b0d-4506-a45e-0c634fa357fe None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:34.925158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78e6cc-8b0d-4506-a45e-0c634fa357fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:34.960622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-de78e6cc-8b0d-4506-a45e-0c634fa357fe None None] MFA Rules not processed for user `7a9617d57a1c4d06a0c5359a4b1907e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:34.967438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-de78e6cc-8b0d-4506-a45e-0c634fa357fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:34.995649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 864/1715] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:35.006054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac20e-0dd1-4aed-b691-097e6a61b6f5 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:35.033544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac20e-0dd1-4aed-b691-097e6a61b6f5 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:35.054443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abcebb-d21e-4858-8fe7-0ec3231c4b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:35.056079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abcebb-d21e-4858-8fe7-0ec3231c4b0d service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:35.059240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abcebb-d21e-4858-8fe7-0ec3231c4b0d service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:35.060248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abcebb-d21e-4858-8fe7-0ec3231c4b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:35.077645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abcebb-d21e-4858-8fe7-0ec3231c4b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:35.080262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abcebb-d21e-4858-8fe7-0ec3231c4b0d service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:35.100922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 852/1716] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:36.419443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc099-6269-4a03-bfdc-62a33c3520aa None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:36.420012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc099-6269-4a03-bfdc-62a33c3520aa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:36.420224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc099-6269-4a03-bfdc-62a33c3520aa None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:36.421950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 865/1717] 10.222.0.18 () {54 vars in 912 bytes} [Tue Sep 6 04:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:36.436290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfc099-6269-4a03-bfdc-62a33c3520aa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:36.437103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:36.438323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:36.439167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:36.442964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-10bfc099-6269-4a03-bfdc-62a33c3520aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:36.491326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfc099-6269-4a03-bfdc-62a33c3520aa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:36.495478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] MFA Rules not processed for user `bf28e8b35a8246778b66c59164947add`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:36.502562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:36.506737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:36.508472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:36.510538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:36.510906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] PATH_INFO: `/v3/projects/72b0b4c931494f03907bdc2ed3451be2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:36.518348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b0b4c931494f03907bdc2ed3451be2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:36.520573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:36.527867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 853/1718] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:22:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:36.531232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:36.536570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:36.576742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd2b3-5e6f-4617-98c2-ef271a335406 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:36.596312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:36.597322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:36.599547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:36.600061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] PATH_INFO: `/v3/projects/4a794bde3a424fc190b56a0725f967ac` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:36.601526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a794bde3a424fc190b56a0725f967ac)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:36.603966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:36.668188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b0b4c931494f03907bdc2ed3451be2', 'request_id': 'req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.686579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b0b4c931494f03907bdc2ed3451be2', 'request_id': 'req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.723067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b0b4c931494f03907bdc2ed3451be2', 'request_id': 'req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.759360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a794bde3a424fc190b56a0725f967ac', 'request_id': 'req-35cae556-99cb-4b81-b4d6-278d4b66a070'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.763331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] The token cache is being invalidate because project 72b0b4c931494f03907bdc2ed3451be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:36.763955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.766466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.769166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 866/1719] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:36 2022] DELETE /identity/v3/projects/72b0b4c931494f03907bdc2ed3451be2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:36.770209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:36.771852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:36.779359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a794bde3a424fc190b56a0725f967ac', 'request_id': 'req-35cae556-99cb-4b81-b4d6-278d4b66a070'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.787249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a794bde3a424fc190b56a0725f967ac', 'request_id': 'req-35cae556-99cb-4b81-b4d6-278d4b66a070'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.864869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] The token cache is being invalidate because project 4a794bde3a424fc190b56a0725f967ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:36.867764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.869998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-35cae556-99cb-4b81-b4d6-278d4b66a070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:36.873792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 854/1720] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:36 2022] DELETE /identity/v3/projects/4a794bde3a424fc190b56a0725f967ac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:36.875397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:36.875886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:36.877921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:36.956693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:36.965608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:36.966205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:37.048594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61eb3f-2f35-4933-8131-a22c6d95e1e3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:37.120457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 855/1721] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:37.122046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:37.124065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:37.148978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c0082-f359-43e9-bbe4-857f72dd8d64 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:37.179707 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:37.180700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:37.181115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:37.181687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] PATH_INFO: `/v3/users/e61406db88ea43b1a8368c833ad7fcc8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:37.184059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61406db88ea43b1a8368c833ad7fcc8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:37.192544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:37.253009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af21a3-02d3-454a-beca-aecd993828c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:37.253880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af21a3-02d3-454a-beca-aecd993828c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:37.254550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af21a3-02d3-454a-beca-aecd993828c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:37.254983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af21a3-02d3-454a-beca-aecd993828c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:37.257729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e0af21a3-02d3-454a-beca-aecd993828c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:37.274886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af21a3-02d3-454a-beca-aecd993828c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:37.283409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af21a3-02d3-454a-beca-aecd993828c8 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:37.343215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:37.347300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 867/1722] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:37.358650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff64ce6-0c53-4ed0-8185-0e49984327bf None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:37.361266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff64ce6-0c53-4ed0-8185-0e49984327bf None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:37.362326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff64ce6-0c53-4ed0-8185-0e49984327bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:37.457352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61406db88ea43b1a8368c833ad7fcc8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:37.495335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fff64ce6-0c53-4ed0-8185-0e49984327bf None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:37.498983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fff64ce6-0c53-4ed0-8185-0e49984327bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:37.499961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61406db88ea43b1a8368c833ad7fcc8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:37.555501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 868/1723] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:37.560004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff64ce6-0c53-4ed0-8185-0e49984327bf None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:37.576432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61406db88ea43b1a8368c833ad7fcc8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:37.577970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61406db88ea43b1a8368c833ad7fcc8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:37.580237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61406db88ea43b1a8368c833ad7fcc8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:37.590551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff64ce6-0c53-4ed0-8185-0e49984327bf None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:37.600490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:37.603156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:37.603661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:37.604128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:37.607443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:37.607960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:37.612665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:37.627686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 856/1724] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:37 2022] DELETE /identity/v3/users/e61406db88ea43b1a8368c833ad7fcc8 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:37.640648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 869/1725] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:37.651071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:37.660756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:37.866989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c496f4-4e12-4f95-94cd-d9719528da7e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:37.883639 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:37.884487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:37.885213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:37.893689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:37.894740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:37.897415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:37.952830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 857/1726] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:37 2022] POST /identity/v3/projects => generated 367 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:37.954105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:37.970865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37539f78-d1a0-44d3-bb2a-5b51f80426b2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:38.166391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:38.167240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:38.167550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:38.168582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:38.169351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:38.174171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:38.245395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 870/1727] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:37 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:38.246061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:38.264983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871995c-9c5f-4633-b296-b3ed1603e2e6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:38.276542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:38.279261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:38.281195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:38.282862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:38.284827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:38.290966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:38.322678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 858/1728] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:38.325238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:38.345724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4c200-0acd-4440-8994-8e6ad19b665e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:38.357796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7067b-3c9b-4d36-8a73-cb3b05ee9f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:38.358416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7067b-3c9b-4d36-8a73-cb3b05ee9f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:38.359416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7067b-3c9b-4d36-8a73-cb3b05ee9f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:38.359695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7067b-3c9b-4d36-8a73-cb3b05ee9f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:38.360354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7067b-3c9b-4d36-8a73-cb3b05ee9f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:38.365861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7067b-3c9b-4d36-8a73-cb3b05ee9f1a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:38.451625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:38.452137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 871/1729] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:38.466178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df33a-23be-49fe-8928-5ef895069913 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:38.480563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c30b4-2ab3-4b90-9515-4a821e24ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:38.481749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c30b4-2ab3-4b90-9515-4a821e24ea16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:38.482041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c30b4-2ab3-4b90-9515-4a821e24ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:38.482314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c30b4-2ab3-4b90-9515-4a821e24ea16 admin admin] PATH_INFO: `/v3/projects/bc7c1da7975c4313b3db543bd4d53183/users/f1f495fddbd64eb3a88873717bf7d5ea/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:38.529977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c30b4-2ab3-4b90-9515-4a821e24ea16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7c1da7975c4313b3db543bd4d53183, user_id=f1f495fddbd64eb3a88873717bf7d5ea, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:38.532814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c30b4-2ab3-4b90-9515-4a821e24ea16 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:38.574805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 859/1730] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:38 2022] PUT /identity/v3/projects/bc7c1da7975c4313b3db543bd4d53183/users/f1f495fddbd64eb3a88873717bf7d5ea/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:38.576572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07e79-9cec-4877-87bc-f45d4b2ef4e5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:38.577034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07e79-9cec-4877-87bc-f45d4b2ef4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:38.577291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07e79-9cec-4877-87bc-f45d4b2ef4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:38.677194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4b811-8b18-417c-8bfe-47ea9287525c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:38.679271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4b811-8b18-417c-8bfe-47ea9287525c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:38.679271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4b811-8b18-417c-8bfe-47ea9287525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:38.683645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-12a07e79-9cec-4877-87bc-f45d4b2ef4e5 None None] MFA Rules not processed for user `f1f495fddbd64eb3a88873717bf7d5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:38.684873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12a07e79-9cec-4877-87bc-f45d4b2ef4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:38.889014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:38.927258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e9a4b811-8b18-417c-8bfe-47ea9287525c None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:38.931653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e9a4b811-8b18-417c-8bfe-47ea9287525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:38.974833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 872/1731] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:38.976178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07e79-9cec-4877-87bc-f45d4b2ef4e5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:39.078318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:39.201230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 860/1732] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:22:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:39.213637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07e79-9cec-4877-87bc-f45d4b2ef4e5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:39.219424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:39.220708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:39.221235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:39.222732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:39.224169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:39.226533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:39.283665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 873/1733] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:38 2022] POST /identity/v3/projects => generated 369 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:39.287710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4b811-8b18-417c-8bfe-47ea9287525c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:39.318636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4b811-8b18-417c-8bfe-47ea9287525c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:39.414616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:39.415452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:39.415739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:39.416108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:39.416760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:39.419814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:39.453243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 861/1734] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:39 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:39.456935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:39.471988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b68ce-f638-47f0-8f70-260ca19b51ca admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:39.488382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:39.490245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:39.490560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:39.492427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:39.494427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:39.498882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:39.501132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:39.502970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:39.581521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 874/1735] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:39.584031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:39.653277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609f0ec-ed94-4fe0-bea3-9541cb4d1949 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:39.679171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:39.680673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:39.681112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:39.681529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] PATH_INFO: `/v3/projects/de41cb5d418f4ce0bfde13b51c5dd4fa/users/53db88f11196451da4fb6ae357ea750d/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:39.732903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de41cb5d418f4ce0bfde13b51c5dd4fa, user_id=53db88f11196451da4fb6ae357ea750d, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:39.736023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:39.775798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 875/1736] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:39 2022] PUT /identity/v3/projects/de41cb5d418f4ce0bfde13b51c5dd4fa/users/53db88f11196451da4fb6ae357ea750d/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:39.777609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:39.948539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65c9e-f1b1-4da8-911b-496397bfc80c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:40.039695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575a337-47c7-4570-b68d-0513d55a945a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:40.054589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf9931-4ad4-4e5b-b33f-e73d1871170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:40.055049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9931-4ad4-4e5b-b33f-e73d1871170b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:40.055467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9931-4ad4-4e5b-b33f-e73d1871170b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:40.055839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9931-4ad4-4e5b-b33f-e73d1871170b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:40.056596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf9931-4ad4-4e5b-b33f-e73d1871170b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:40.057763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:40.058993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf9931-4ad4-4e5b-b33f-e73d1871170b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:40.088152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 876/1737] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:40.093201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9d56e-2a17-43e1-951f-efe42b4c6e87 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:40.093613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9d56e-2a17-43e1-951f-efe42b4c6e87 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:40.094068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9d56e-2a17-43e1-951f-efe42b4c6e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:40.109871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97303763-4f4d-4b1c-87f3-e241c568731a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:40.113367 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303763-4f4d-4b1c-87f3-e241c568731a service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:40.113686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303763-4f4d-4b1c-87f3-e241c568731a service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:40.113961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303763-4f4d-4b1c-87f3-e241c568731a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:40.156209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-eca9d56e-2a17-43e1-951f-efe42b4c6e87 None None] MFA Rules not processed for user `f8f46235d0d34ba5bbb60e675002fc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:40.157676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eca9d56e-2a17-43e1-951f-efe42b4c6e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:40.225319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:40.356922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97303763-4f4d-4b1c-87f3-e241c568731a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:40.361375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97303763-4f4d-4b1c-87f3-e241c568731a service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:40.379113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 877/1738] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:40.380332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9d56e-2a17-43e1-951f-efe42b4c6e87 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:40.399913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 862/1739] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 899 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:22:40.412639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9d56e-2a17-43e1-951f-efe42b4c6e87 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:40.425497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:40.426419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:40.426712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:40.427078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] PATH_INFO: `/v3/projects/de41cb5d418f4ce0bfde13b51c5dd4fa/users/53db88f11196451da4fb6ae357ea750d/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:40.444356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de41cb5d418f4ce0bfde13b51c5dd4fa, user_id=53db88f11196451da4fb6ae357ea750d, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:40.469774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:40.564271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 878/1740] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:40 2022] PUT /identity/v3/projects/de41cb5d418f4ce0bfde13b51c5dd4fa/users/53db88f11196451da4fb6ae357ea750d/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:40.583347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:40.583896 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:40.583979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:40.726597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] MFA Rules not processed for user `53db88f11196451da4fb6ae357ea750d`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:40.727888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:40.910347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:40.912373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:41.050942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 863/1741] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:41.071874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:41.074751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:41.204545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b190c-09ee-4242-b335-3ba69ad21b47 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:41.237131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:41.237131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:41.237131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:41.237592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] PATH_INFO: `/v3/projects/1cefaba5b1654d8ea05601099e1f7420` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:41.241484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cefaba5b1654d8ea05601099e1f7420)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:41.246290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:41.299968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0a2c-44dc-45b7-9da7-e30f599995ab None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:41.312064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a066c0-5d52-4131-8439-69457efd52ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:41.312705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a066c0-5d52-4131-8439-69457efd52ff service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:41.312976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a066c0-5d52-4131-8439-69457efd52ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:41.313247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a066c0-5d52-4131-8439-69457efd52ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:41.347993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a066c0-5d52-4131-8439-69457efd52ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:41.349614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a066c0-5d52-4131-8439-69457efd52ff service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:41.394153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 864/1742] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:41.404707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cefaba5b1654d8ea05601099e1f7420', 'request_id': 'req-fdeed4f3-f875-4148-b6f8-75fc6594bab7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:41.419345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cefaba5b1654d8ea05601099e1f7420', 'request_id': 'req-fdeed4f3-f875-4148-b6f8-75fc6594bab7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:41.430400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cefaba5b1654d8ea05601099e1f7420', 'request_id': 'req-fdeed4f3-f875-4148-b6f8-75fc6594bab7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:41.450763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] The token cache is being invalidate because project 1cefaba5b1654d8ea05601099e1f7420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:41.451082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:41.452358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdeed4f3-f875-4148-b6f8-75fc6594bab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:41.454173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 879/1743] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:40 2022] DELETE /identity/v3/projects/1cefaba5b1654d8ea05601099e1f7420 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:22:41.459993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e1ed-6db2-45fd-a7ea-d376378442b1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:41.460443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e1ed-6db2-45fd-a7ea-d376378442b1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:41.460821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e1ed-6db2-45fd-a7ea-d376378442b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:41.534032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-cc75e1ed-6db2-45fd-a7ea-d376378442b1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:41.540903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cc75e1ed-6db2-45fd-a7ea-d376378442b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:41.553566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:41.796035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 865/1744] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:41.799366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c8aa4-070b-47bd-8489-e9f3efcda49f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:41.802208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c8aa4-070b-47bd-8489-e9f3efcda49f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:41.802881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c8aa4-070b-47bd-8489-e9f3efcda49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:41.878348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-933c8aa4-070b-47bd-8489-e9f3efcda49f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:41.879634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-933c8aa4-070b-47bd-8489-e9f3efcda49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:41.910045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 880/1745] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:41.914859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e1ed-6db2-45fd-a7ea-d376378442b1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:41.954583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e1ed-6db2-45fd-a7ea-d376378442b1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:41.987773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eeb48-9aea-40bf-9e0d-1df907d5b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:41.990645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eeb48-9aea-40bf-9e0d-1df907d5b767 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:41.990645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eeb48-9aea-40bf-9e0d-1df907d5b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:41.990645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eeb48-9aea-40bf-9e0d-1df907d5b767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:41.990645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eeb48-9aea-40bf-9e0d-1df907d5b767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:41.990645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eeb48-9aea-40bf-9e0d-1df907d5b767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:41.995564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eeb48-9aea-40bf-9e0d-1df907d5b767 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:42.019600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 866/1746] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:42.022120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c8aa4-070b-47bd-8489-e9f3efcda49f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:42.035238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c8aa4-070b-47bd-8489-e9f3efcda49f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:42.058409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:42.093619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:42.094046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:42.094343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:42.095026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:42.109308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:42.119649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e638-6b43-41d1-b240-784a92f2430c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:42.120069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e638-6b43-41d1-b240-784a92f2430c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:42.120509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e638-6b43-41d1-b240-784a92f2430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:42.178037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-61a7e638-6b43-41d1-b240-784a92f2430c None None] MFA Rules not processed for user `73104db15e224f4ba00f9ab79ed46957`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:42.180191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-61a7e638-6b43-41d1-b240-784a92f2430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:42.301615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 881/1747] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:42 2022] POST /identity/v3/projects => generated 365 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:42.304454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:42.391687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:42.426147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 867/1748] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:42.616005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845950f7-6b25-4df3-8874-71d4ed42d21b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:42.640034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:42.643503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:42.643833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:42.644115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:42.644784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:42.663508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:42.708836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 882/1749] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:42 2022] POST /identity/v3/users => generated 283 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:42.710308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e638-6b43-41d1-b240-784a92f2430c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:42.728259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:42.730213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:42.736804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e638-6b43-41d1-b240-784a92f2430c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:42.750754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:42.752034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:42.754398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:42.754904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:42.757260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:42.758875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54846e-7073-48ae-a7b2-0eca02ce2ec8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:42.764741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:42.768022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:42.768022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:42.768022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:42.768022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] PATH_INFO: `/v3/users/f1f495fddbd64eb3a88873717bf7d5ea` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:42.769208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f495fddbd64eb3a88873717bf7d5ea)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:42.771909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:42.822605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 868/1750] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:42.826312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:42.887847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b980b1-0fbc-459a-976f-9f51f5b41130 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:42.921877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:42.921877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:42.923759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:42.924705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:42.950795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:42.953124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:42.968064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f495fddbd64eb3a88873717bf7d5ea'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:43.002405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f495fddbd64eb3a88873717bf7d5ea'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:43.015294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 869/1751] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:43.020296 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:43.048891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f495fddbd64eb3a88873717bf7d5ea'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:43.051891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f495fddbd64eb3a88873717bf7d5ea'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:43.054045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76ab8e25-0649-423c-a574-9ee0cf39f13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f495fddbd64eb3a88873717bf7d5ea'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:43.056787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1818-7cf4-435f-99fe-27c2cad8b9ed admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:43.087086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945a795-2e36-483b-a64a-e1e59ab5cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:43.087086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a795-2e36-483b-a64a-e1e59ab5cca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:43.087086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a795-2e36-483b-a64a-e1e59ab5cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:43.087086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a795-2e36-483b-a64a-e1e59ab5cca2 admin admin] PATH_INFO: `/v3/projects/50cb5ef6c873492a828220a81384eb77/users/e034bd1011024897b00527c891b6a64e/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:43.105047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 883/1752] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:42 2022] DELETE /identity/v3/users/f1f495fddbd64eb3a88873717bf7d5ea => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:22:43.107437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:43.107894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:43.108379 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:43.138434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a795-2e36-483b-a64a-e1e59ab5cca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cb5ef6c873492a828220a81384eb77, user_id=e034bd1011024897b00527c891b6a64e, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:43.146079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a795-2e36-483b-a64a-e1e59ab5cca2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:43.167126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:43.167126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:43.191410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 870/1753] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:43 2022] PUT /identity/v3/projects/50cb5ef6c873492a828220a81384eb77/users/e034bd1011024897b00527c891b6a64e/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:43.195820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:43.196103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:43.196487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:43.268050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] MFA Rules not processed for user `e034bd1011024897b00527c891b6a64e`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:43.268050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:43.387593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:43.422095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 884/1754] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:43.440187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 871/1755] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:43.441946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:43.443823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:43.476916 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8712c-1946-4551-ba6b-4045563129e1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:43.539041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:43.689694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:43.693092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:43.720363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:43.722652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:43.723945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:43.725023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:43.727510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:43.733580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:43.822312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 885/1756] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:43 2022] POST /identity/v3/projects => generated 365 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:43.827018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:43.850386 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b34c-d3b5-4423-a43d-e88a0faadf01 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:43.953246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:43.955179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:43.955179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:43.955179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.013396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7fa15-84e4-42b0-93c9-0d04673c0ea5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:44.031043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:44.033684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.035201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.035676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.037334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:44.052740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:44.138826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:44.140566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:44.160707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 886/1757] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:43 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:44.165345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:44.169550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 872/1758] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:44.200346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e526d-d888-45fb-a333-95d156b2e91b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:44.219680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f02c-aed4-486a-8018-4a4296068856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:44.220419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f02c-aed4-486a-8018-4a4296068856 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.220761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f02c-aed4-486a-8018-4a4296068856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.221033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f02c-aed4-486a-8018-4a4296068856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.222354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388f02c-aed4-486a-8018-4a4296068856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:44.243503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388f02c-aed4-486a-8018-4a4296068856 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:44.310835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 887/1759] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:44.315160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:44.328508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da84d3-f6c9-4f72-813c-9406fb33acef service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:44.340036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:44.340888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.341262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.341639 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] PATH_INFO: `/v3/projects/8abfd9964c5b4becbc5bf68b169c098c/users/b7b2baa6bd1a4648a161d5e69c5bbd12/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.403179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abfd9964c5b4becbc5bf68b169c098c, user_id=b7b2baa6bd1a4648a161d5e69c5bbd12, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:44.406585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:44.422510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca52d-9e08-44f6-8366-a9d06a52a968 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.422902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca52d-9e08-44f6-8366-a9d06a52a968 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.423102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca52d-9e08-44f6-8366-a9d06a52a968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.441877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 873/1760] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:44 2022] PUT /identity/v3/projects/8abfd9964c5b4becbc5bf68b169c098c/users/b7b2baa6bd1a4648a161d5e69c5bbd12/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:44.446343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:44.503989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-462ca52d-9e08-44f6-8366-a9d06a52a968 None None] MFA Rules not processed for user `bf28e8b35a8246778b66c59164947add`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:44.516153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-462ca52d-9e08-44f6-8366-a9d06a52a968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:44.536658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:44.713500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 888/1761] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Sep 6 04:22:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:44.722621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5663296-66d4-47c1-a698-0b33c1fb5a8d admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:44.737217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:44.737855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.738172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.738448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.747201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:44.752910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:44.798309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca52d-9e08-44f6-8366-a9d06a52a968 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:44.798594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 874/1762] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:44.802081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:44.811676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:44.831849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca52d-9e08-44f6-8366-a9d06a52a968 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:44.851408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b8683-5317-4cc5-8e6b-e471ab462261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:44.852900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8683-5317-4cc5-8e6b-e471ab462261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.857721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8683-5317-4cc5-8e6b-e471ab462261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.858126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8683-5317-4cc5-8e6b-e471ab462261 admin admin] PATH_INFO: `/v3/projects/8abfd9964c5b4becbc5bf68b169c098c/users/b7b2baa6bd1a4648a161d5e69c5bbd12/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.864680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b8683-5317-4cc5-8e6b-e471ab462261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abfd9964c5b4becbc5bf68b169c098c, user_id=b7b2baa6bd1a4648a161d5e69c5bbd12, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:44.866863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159a9a2-0816-4b0c-9903-9a45356dae44 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:44.875118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b8683-5317-4cc5-8e6b-e471ab462261 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:44.894640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:44.895675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.896180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.896647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.919700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:44.921669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:44.941946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 889/1763] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:44 2022] PUT /identity/v3/projects/8abfd9964c5b4becbc5bf68b169c098c/users/b7b2baa6bd1a4648a161d5e69c5bbd12/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:44.957586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:44.957922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:44.958166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:44.959611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 875/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:45.126435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] MFA Rules not processed for user `b7b2baa6bd1a4648a161d5e69c5bbd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:45.127821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:45.142458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:45.409148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 890/1765] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:45.437210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:45.442346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:45.771403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639f227-8330-4afe-a7b1-be46fc3d2d4d service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:45.990271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:45.991818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:45.992299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:45.994068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:46.031717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:46.043233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:46.066209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 876/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:46.163635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:46.166842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:46.290637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:46.305035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642905-bb02-4308-b5f5-6c6feb260197 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:46.322593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:46.324415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:46.325426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:46.326099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:46.446409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c1578-985b-45a6-be70-2c69689347c5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:46.452909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:46.454432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:46.454873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:46.455302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] PATH_INFO: `/v3/users/d0bccab0a8134a5787ec9251ab9d25de` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:46.456897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bccab0a8134a5787ec9251ab9d25de)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:46.459558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:46.587363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bccab0a8134a5787ec9251ab9d25de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:46.595506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:46.608799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:46.637917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bccab0a8134a5787ec9251ab9d25de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:46.692717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 877/1767] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:22:46.693740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:46.712379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:46.775013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bccab0a8134a5787ec9251ab9d25de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:46.779588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bccab0a8134a5787ec9251ab9d25de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:46.784177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebbe67c-863b-44a9-b4ed-761d705bdfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bccab0a8134a5787ec9251ab9d25de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:46.815929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a154bd-4529-415e-980e-f233d4eeec74 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:46.832337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:46.835686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:46.836199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:46.836609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] PATH_INFO: `/v3/projects/bc7c1da7975c4313b3db543bd4d53183` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:46.841151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7c1da7975c4313b3db543bd4d53183)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:46.843488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:46.845182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 891/1768] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:46 2022] DELETE /identity/v3/users/d0bccab0a8134a5787ec9251ab9d25de => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:46.850052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:46.853076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:46.855578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:46.857452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:46.963244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:46.971005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:47.059686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:47.074322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7c1da7975c4313b3db543bd4d53183', 'request_id': 'req-2d5c3446-74a9-45ef-b1f8-8f476694c166'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.135682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7c1da7975c4313b3db543bd4d53183', 'request_id': 'req-2d5c3446-74a9-45ef-b1f8-8f476694c166'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.183521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7c1da7975c4313b3db543bd4d53183', 'request_id': 'req-2d5c3446-74a9-45ef-b1f8-8f476694c166'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.253242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] The token cache is being invalidate because project bc7c1da7975c4313b3db543bd4d53183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:47.255021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.257950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.265563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 878/1769] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:46 2022] DELETE /identity/v3/projects/bc7c1da7975c4313b3db543bd4d53183 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:47.269494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:47.272996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:47.305243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 892/1770] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:47.333368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3446-74a9-45ef-b1f8-8f476694c166 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:47.358021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:47.361807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:47.362151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:47.362454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] PATH_INFO: `/v3/users/53db88f11196451da4fb6ae357ea750d` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:47.376020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53db88f11196451da4fb6ae357ea750d)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:47.387821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:47.434046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:47.437767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:47.598559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53db88f11196451da4fb6ae357ea750d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.625551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53db88f11196451da4fb6ae357ea750d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.689273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53db88f11196451da4fb6ae357ea750d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.690745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53db88f11196451da4fb6ae357ea750d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.693912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53db88f11196451da4fb6ae357ea750d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:47.751760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 879/1771] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:47 2022] DELETE /identity/v3/users/53db88f11196451da4fb6ae357ea750d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:47.820834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1a7cf-4754-4851-a0b1-e11a2aebbe63 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:48.036856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:48.043291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:48.048122 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:48.048122 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:48.053267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:48.346964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:48.349812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:48.376897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 893/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 943 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:50.530320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:50.532452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:50.583965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4b553-b8d3-4429-bc9d-f37018f6007b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:50.603799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:50.605647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:50.606256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:50.606547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] PATH_INFO: `/v3/projects/7ae1c87681a54acaa74b394a71bd13b8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:50.610679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae1c87681a54acaa74b394a71bd13b8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:50.616880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:50.770722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:50.773623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:50.792626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18e5ed-5507-4259-8a87-f7a1ddeee321 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:50.804950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae1c87681a54acaa74b394a71bd13b8', 'request_id': 'req-e8486143-989c-4e15-8e6d-8f01f0d47c5a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:50.855090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae1c87681a54acaa74b394a71bd13b8', 'request_id': 'req-e8486143-989c-4e15-8e6d-8f01f0d47c5a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:50.857281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=75,keystone:DELETE=22,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:50.871669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae1c87681a54acaa74b394a71bd13b8', 'request_id': 'req-e8486143-989c-4e15-8e6d-8f01f0d47c5a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:50.874575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:50.888972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] The token cache is being invalidate because project 7ae1c87681a54acaa74b394a71bd13b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:50.889533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:50.893711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e8486143-989c-4e15-8e6d-8f01f0d47c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:50.900208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 880/1773] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:50 2022] DELETE /identity/v3/projects/7ae1c87681a54acaa74b394a71bd13b8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:50.904998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea14f-6f1c-42e5-8055-5c635a92f56b None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:50.905719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea14f-6f1c-42e5-8055-5c635a92f56b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:50.906217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea14f-6f1c-42e5-8055-5c635a92f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:50.973477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:50.975003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:50.975289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:50.976278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] PATH_INFO: `/v3/projects/de41cb5d418f4ce0bfde13b51c5dd4fa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:50.978006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-37aea14f-6f1c-42e5-8055-5c635a92f56b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:50.978961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de41cb5d418f4ce0bfde13b51c5dd4fa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:50.981550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-37aea14f-6f1c-42e5-8055-5c635a92f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:50.985624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:51.020322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 881/1774] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:51.029238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57bb23-036b-4546-9439-d0267093affe None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.030109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57bb23-036b-4546-9439-d0267093affe None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.030671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57bb23-036b-4546-9439-d0267093affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.081102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-df57bb23-036b-4546-9439-d0267093affe None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:51.082809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-df57bb23-036b-4546-9439-d0267093affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:51.098804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 882/1775] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:51.104231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57bb23-036b-4546-9439-d0267093affe None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:51.115475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57bb23-036b-4546-9439-d0267093affe None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:51.145772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:51.146416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.146680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.146951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.147743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:51.147991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:51.149617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:51.200881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 883/1776] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:51.202039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:51.238726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732508d4-ffce-4a4d-9d6c-f810718db446 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:51.273192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de41cb5d418f4ce0bfde13b51c5dd4fa', 'request_id': 'req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:51.311130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de41cb5d418f4ce0bfde13b51c5dd4fa', 'request_id': 'req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:51.344950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de41cb5d418f4ce0bfde13b51c5dd4fa', 'request_id': 'req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:51.408460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] The token cache is being invalidate because project de41cb5d418f4ce0bfde13b51c5dd4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:51.414945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:51.417432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:51.417861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.418189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.418433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.422208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b0dfa24f-8682-44e3-8b81-cdb3bce65bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:51.422637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:51.425144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:51.433684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 894/1777] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:50 2022] DELETE /identity/v3/projects/de41cb5d418f4ce0bfde13b51c5dd4fa => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:22:51.439715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debe910-6f50-4451-b074-226fd482e783 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.440560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debe910-6f50-4451-b074-226fd482e783 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.442820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debe910-6f50-4451-b074-226fd482e783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.530719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 884/1778] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:51 2022] POST /identity/v3/projects => generated 403 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:51.538059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:51.545473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:51.547955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1debe910-6f50-4451-b074-226fd482e783 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:51.552987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1debe910-6f50-4451-b074-226fd482e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:51.813551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 895/1779] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:51.830024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc28fe-9656-4cfe-98cb-9e02fcf45325 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.831723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc28fe-9656-4cfe-98cb-9e02fcf45325 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.833497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc28fe-9656-4cfe-98cb-9e02fcf45325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.858923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98e7b4-19c0-4547-a677-4d708100a70f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:51.887561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc79f-f8ef-4f22-9ddb-aab1430d3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:51.890168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc79f-f8ef-4f22-9ddb-aab1430d3878 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.892515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc79f-f8ef-4f22-9ddb-aab1430d3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.893569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc79f-f8ef-4f22-9ddb-aab1430d3878 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.899939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbc79f-f8ef-4f22-9ddb-aab1430d3878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:51.903735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbc79f-f8ef-4f22-9ddb-aab1430d3878 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:51.915538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4fcc28fe-9656-4cfe-98cb-9e02fcf45325 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:51.916845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4fcc28fe-9656-4cfe-98cb-9e02fcf45325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:51.955356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 885/1780] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:51 2022] POST /identity/v3/users => generated 302 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:51.957617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313043f8-d765-4528-8c21-7a49e964cc99 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.957913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313043f8-d765-4528-8c21-7a49e964cc99 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.958256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313043f8-d765-4528-8c21-7a49e964cc99 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.960513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 886/1781] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:51.965417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4758-336b-440b-a77d-f579c2a61e3d None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:51.965758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4758-336b-440b-a77d-f579c2a61e3d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:51.967764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4758-336b-440b-a77d-f579c2a61e3d None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:51.973479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 887/1782] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:22:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:22:51.974586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4758-336b-440b-a77d-f579c2a61e3d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:51.987055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 896/1783] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:51.989594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc28fe-9656-4cfe-98cb-9e02fcf45325 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:52.034968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4758-336b-440b-a77d-f579c2a61e3d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.045079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:52.046823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc28fe-9656-4cfe-98cb-9e02fcf45325 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.048213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.048514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.048795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.052673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:52.074382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:52.076531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.079178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:52.080493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.080493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.082879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:52.087174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:52.092115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:52.131917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 888/1784] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:52.133147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:52.142331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 897/1785] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:22:52.149606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:52.164375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2239-32f4-44a1-a757-f4d73be158aa admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.191183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef7200-b7d5-483d-be2b-b4f42955fb04 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.210555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053c74-8e04-4027-82cb-3c68304ff94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:52.211461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f3db4-0172-4f8f-a14b-3d3942cd8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:52.212096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3db4-0172-4f8f-a14b-3d3942cd8e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.212381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3db4-0172-4f8f-a14b-3d3942cd8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.212639 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3db4-0172-4f8f-a14b-3d3942cd8e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.213295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f3db4-0172-4f8f-a14b-3d3942cd8e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:52.221437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053c74-8e04-4027-82cb-3c68304ff94c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.221951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053c74-8e04-4027-82cb-3c68304ff94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.222242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053c74-8e04-4027-82cb-3c68304ff94c admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.226099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11053c74-8e04-4027-82cb-3c68304ff94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:52.230421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11053c74-8e04-4027-82cb-3c68304ff94c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:52.231200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f3db4-0172-4f8f-a14b-3d3942cd8e95 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:52.335747 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 889/1786] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:52.336555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 898/1787] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:52 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:52.338437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51af326-afdd-4a59-80c3-e6a3c2fb9f35 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.341410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51af326-afdd-4a59-80c3-e6a3c2fb9f35 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.342015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51af326-afdd-4a59-80c3-e6a3c2fb9f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.342916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd718a9-e6a6-4a84-93fd-50cdcbcb2044 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.345985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd718a9-e6a6-4a84-93fd-50cdcbcb2044 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.346527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd718a9-e6a6-4a84-93fd-50cdcbcb2044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.411739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d51af326-afdd-4a59-80c3-e6a3c2fb9f35 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:52.421110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d51af326-afdd-4a59-80c3-e6a3c2fb9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:52.440682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-bbd718a9-e6a6-4a84-93fd-50cdcbcb2044 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:52.468460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:52.469343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-bbd718a9-e6a6-4a84-93fd-50cdcbcb2044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:52.494178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:52.626348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 899/1788] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:22:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:52.627319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51af326-afdd-4a59-80c3-e6a3c2fb9f35 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:52.726015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 890/1789] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:22:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:52.755828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd718a9-e6a6-4a84-93fd-50cdcbcb2044 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:52.784489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd718a9-e6a6-4a84-93fd-50cdcbcb2044 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.793632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:52.794636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51af326-afdd-4a59-80c3-e6a3c2fb9f35 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.795040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.795611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.796538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.797412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:52.800135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:52.827495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9d265-fff2-42bc-9658-bd069e746b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:52.828187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d265-fff2-42bc-9658-bd069e746b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.828733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d265-fff2-42bc-9658-bd069e746b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.829160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d265-fff2-42bc-9658-bd069e746b17 admin admin] PATH_INFO: `/v3/projects/5428ae5edbe3496f8d2f30aa711fa15e/users/accdb30a12dd41d39d378afc25a80019/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.844459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 891/1790] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:52 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:52.845548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:52.871754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dd798-3af5-42a1-941b-445c0a95ed0c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.887735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9d265-fff2-42bc-9658-bd069e746b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5428ae5edbe3496f8d2f30aa711fa15e, user_id=accdb30a12dd41d39d378afc25a80019, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:52.890583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9d265-fff2-42bc-9658-bd069e746b17 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:52.893524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:52.894479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.895125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.895875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:52.897951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:52.901513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:52.936830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 892/1791] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:52.938238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:52.967408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 900/1792] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:52 2022] PUT /identity/v3/projects/5428ae5edbe3496f8d2f30aa711fa15e/users/accdb30a12dd41d39d378afc25a80019/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:52.970216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c4c8-c14e-47bc-82b6-f0c46e37faff admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:52.975834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:52.976332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:52.976773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:53.021569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:53.023073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:53.198228 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 901/1793] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:53.216966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:53.217654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:53.217871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:53.218140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:53.218822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:53.220661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:53.239492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:53.241225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:53.259640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 893/1794] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:53.260845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:53.285723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545afb-676b-4d6f-85ca-1b8cfea65be2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:53.296345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bb6ba-ed89-4ff8-aafb-4b37e276c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:53.297589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb6ba-ed89-4ff8-aafb-4b37e276c7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:53.297882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb6ba-ed89-4ff8-aafb-4b37e276c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:53.298182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb6ba-ed89-4ff8-aafb-4b37e276c7c1 admin admin] PATH_INFO: `/v3/projects/3299ee2164b54d339800191409e19bad/users/b39122176f7940f3bbf7b2a4c0ae0373/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:53.324983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bb6ba-ed89-4ff8-aafb-4b37e276c7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3299ee2164b54d339800191409e19bad, user_id=b39122176f7940f3bbf7b2a4c0ae0373, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:53.329992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bb6ba-ed89-4ff8-aafb-4b37e276c7c1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:53.366365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 894/1795] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:53 2022] PUT /identity/v3/projects/3299ee2164b54d339800191409e19bad/users/b39122176f7940f3bbf7b2a4c0ae0373/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:53.367244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:53.368790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:53.369028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:53.369341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:53.419966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079300-8d35-4339-a598-4952c9d4bffb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:53.451587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] MFA Rules not processed for user `b39122176f7940f3bbf7b2a4c0ae0373`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:53.453633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:53.545742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:53.547812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:53.548098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:53.548376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:53.561204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:53.751454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 895/1796] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:22:53.751454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:53.757394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:53.830900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:53.833318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:53.861953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 902/1797] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:22:53.864413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:53.869613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:53.958919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835741a-1dfb-4d3c-8b5d-d0f50a3f637a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:53.988825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:53.990736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:53.992821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:53.995609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:54.036058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:54.044372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:54.095195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 896/1798] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:54.113866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:54.138095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97da3fe-630d-40a2-b001-ba70edc28908 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:54.157672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:54.159949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:54.160470 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:54.160902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:54.173779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:54.176028 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:54.195026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 903/1799] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:54.211679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410307e4-22ad-42dc-9f1c-3002ff2af89a service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:54.276680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:54.277262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:54.277591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:54.277862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:54.278507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:54.280615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:54.410113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 897/1800] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:54 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:54.414221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:54.439267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58caabf-fe44-4a20-be0a-8484766ddab5 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:54.564052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:54.691469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:54.692097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:54.692384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:54.692672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:54.693320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:54.703647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:54.768124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 904/1801] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:54 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:54.769427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:54.789119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b483e6-c911-4069-a203-6df400e2cd82 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:54.799285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:54.801517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:54.804875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:54.805334 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:54.806155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:54.808717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:54.832443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 898/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:54.835259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:54.850094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940f502-23c7-4d93-8b3d-a3f0f24368f1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:54.875254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c10a39-a85a-4058-9169-13233219314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:54.876385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10a39-a85a-4058-9169-13233219314c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:54.878005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10a39-a85a-4058-9169-13233219314c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:54.878498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10a39-a85a-4058-9169-13233219314c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:54.879899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c10a39-a85a-4058-9169-13233219314c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:54.887270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c10a39-a85a-4058-9169-13233219314c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:54.922479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 905/1803] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:54.927201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:54.939595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45663-2658-4c3d-b244-404cbe41a7f0 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:54.949952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:54.950676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:54.950989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:54.951252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] PATH_INFO: `/v3/projects/4929ef41a60b42a184a1cbce51e6bb87/users/abc9bb3227924762878346ffcf415c6e/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:54.993695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4929ef41a60b42a184a1cbce51e6bb87, user_id=abc9bb3227924762878346ffcf415c6e, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:54.996792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:55.027618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 899/1804] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:54 2022] PUT /identity/v3/projects/4929ef41a60b42a184a1cbce51e6bb87/users/abc9bb3227924762878346ffcf415c6e/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:55.035091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d2569-9167-4a51-8739-0960fc72c334 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:55.035430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d2569-9167-4a51-8739-0960fc72c334 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:55.035686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d2569-9167-4a51-8739-0960fc72c334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:55.099104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-500d2569-9167-4a51-8739-0960fc72c334 None None] MFA Rules not processed for user `abc9bb3227924762878346ffcf415c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:55.102881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-500d2569-9167-4a51-8739-0960fc72c334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:55.308763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 906/1805] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:55.313409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:55.482946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b9be-f204-434f-8911-17974e3ff5dd admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:55.501475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:55.502249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:55.507666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:55.507980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:55.508694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:55.510869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:55.530391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:55.563419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 900/1806] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:55 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:55.564929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d2569-9167-4a51-8739-0960fc72c334 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:55.589755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d2569-9167-4a51-8739-0960fc72c334 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:55.728354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:55.732131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:55.732416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:55.732689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:55.737740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:55.744419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:55.812345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:55.813126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 907/1807] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:55 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:55.828497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be76e6-fd15-4ef4-b194-5952fe61cc64 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:55.844853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:55.846213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:55.847754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:55.848185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:55.849257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:55.855499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:55.884156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 901/1808] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:55.888223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:55.905585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa858a5e-caf5-4fbd-89f4-efc57448e17d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:55.931898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:55.933342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:55.933732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:55.934119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] PATH_INFO: `/v3/projects/01deaff9711b4d0081c1c35ae433f996/users/5048b4cdb1a84501928fbc602da00ce9/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:55.961429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01deaff9711b4d0081c1c35ae433f996, user_id=5048b4cdb1a84501928fbc602da00ce9, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:55.965865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:55.990489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:56.000888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 908/1809] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:55 2022] PUT /identity/v3/projects/01deaff9711b4d0081c1c35ae433f996/users/5048b4cdb1a84501928fbc602da00ce9/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:56.001889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:56.014941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497449d7-b12d-45d9-af41-e044a2948e69 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:56.186630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43fdd8-d3bb-484e-8e84-b39e39ee1f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:56.187635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fdd8-d3bb-484e-8e84-b39e39ee1f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:56.188042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fdd8-d3bb-484e-8e84-b39e39ee1f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:56.188601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fdd8-d3bb-484e-8e84-b39e39ee1f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:56.189572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43fdd8-d3bb-484e-8e84-b39e39ee1f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:56.192322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43fdd8-d3bb-484e-8e84-b39e39ee1f74 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:56.227357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 902/1810] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:22:56.232542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:56.287128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9370a70-c4b5-462e-9b1d-af70f90cc590 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:56.302127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:56.303613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:56.304118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:56.304850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] PATH_INFO: `/v3/projects/01deaff9711b4d0081c1c35ae433f996/users/5048b4cdb1a84501928fbc602da00ce9/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:56.307857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01deaff9711b4d0081c1c35ae433f996, user_id=5048b4cdb1a84501928fbc602da00ce9, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:56.311198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:56.341128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 909/1811] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:56 2022] PUT /identity/v3/projects/01deaff9711b4d0081c1c35ae433f996/users/5048b4cdb1a84501928fbc602da00ce9/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:56.343179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:56.343811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:56.344278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:56.413328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] MFA Rules not processed for user `5048b4cdb1a84501928fbc602da00ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:56.414869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:56.569396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 903/1812] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:56.580069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:56.582041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:56.594739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:56.597613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:56.692026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c4741-9ea8-4605-9de7-5adfef726998 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:56.700735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9202a0-2be6-4447-8641-cc0bc1fa2d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:56.702450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9202a0-2be6-4447-8641-cc0bc1fa2d2b service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:56.702964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9202a0-2be6-4447-8641-cc0bc1fa2d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:56.708077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9202a0-2be6-4447-8641-cc0bc1fa2d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:56.711410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59866f57-a434-493c-a27a-e382bcca6921 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:56.719105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:56.719867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:56.720206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:56.720688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] PATH_INFO: `/v3/users/e034bd1011024897b00527c891b6a64e` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:56.722203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e034bd1011024897b00527c891b6a64e)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:56.725831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:56.728227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:56.730290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9202a0-2be6-4447-8641-cc0bc1fa2d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:56.733675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9202a0-2be6-4447-8641-cc0bc1fa2d2b service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:56.764137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 910/1813] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:56.812248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e034bd1011024897b00527c891b6a64e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:56.822509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e034bd1011024897b00527c891b6a64e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:56.841450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e034bd1011024897b00527c891b6a64e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:56.842423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e034bd1011024897b00527c891b6a64e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:56.843149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e034bd1011024897b00527c891b6a64e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:56.865641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5643-316d-4096-a02e-8475a4f0944b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:56.865997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5643-316d-4096-a02e-8475a4f0944b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:56.866357 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5643-316d-4096-a02e-8475a4f0944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:56.869970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 904/1814] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:56 2022] DELETE /identity/v3/users/e034bd1011024897b00527c891b6a64e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:56.891947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6e5c5643-316d-4096-a02e-8475a4f0944b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:56.893980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6e5c5643-316d-4096-a02e-8475a4f0944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:57.012280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 911/1815] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:57.032143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:57.034786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:57.154734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa53154-ffbf-473f-8ffa-f0bdc972ec81 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:57.158659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:57.165051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:57.165051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:57.165051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:57.170689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:57.172351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:57.185518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 905/1816] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:22:57.656255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:57.656670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:57.657060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:57.729887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] MFA Rules not processed for user `accdb30a12dd41d39d378afc25a80019`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:57.731309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:57.779746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:57.783579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:57.862093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576a82d-64cd-44e1-be51-348ec3fbd7dc service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:57.866815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:57.867465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:57.868009 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:57.868450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:57.870322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:57.899596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 912/1817] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:57.904745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:57.906259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:57.918979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:57.924519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05087dc3-1a93-42f5-8b07-1bbd831ba190 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:57.936890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:57.938537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:57.939031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:57.939584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:57.942063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:57.946738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:57.962434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:57.964595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:57.978003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 906/1818] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:22:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:22:58.007006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:58.022864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 913/1819] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:22:57 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:58.027564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:58.046069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5434-d21b-40e9-a76a-eac336e89839 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:58.156205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:58.158139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:58.160443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:58.161121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:58.161121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:58.161551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:58.162428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:58.165516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:58.178618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf75d1-cde6-4942-a3fd-10d8cc42efcd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:58.186666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:58.188048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:58.201174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:58.201588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] PATH_INFO: `/v3/projects/50cb5ef6c873492a828220a81384eb77` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:58.203633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cb5ef6c873492a828220a81384eb77)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:58.206164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:58.209462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 907/1820] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:22:58 2022] POST /identity/v3/users => generated 308 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:22:58.218309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:58.242302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a64e6-26d9-4890-89f2-8b64245a2cac admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:58.250312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:58.251251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:58.252893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:58.253559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:58.254890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:58.258030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:58.284067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 908/1821] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:22:58.292997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:58.329833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60e370-87fd-4624-b07a-2fd8f65c6f45 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:58.337178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cb5ef6c873492a828220a81384eb77', 'request_id': 'req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.351731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cb5ef6c873492a828220a81384eb77', 'request_id': 'req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.361305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cb5ef6c873492a828220a81384eb77', 'request_id': 'req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.393099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] The token cache is being invalidate because project 50cb5ef6c873492a828220a81384eb77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:58.395336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.396221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.400281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 914/1822] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:58 2022] DELETE /identity/v3/projects/50cb5ef6c873492a828220a81384eb77 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:58.404770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:58.407114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:58.435414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:58.437411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:58.439771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:58.440357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] PATH_INFO: `/v3/projects/b78e9a3f85894c91b45b09d9e933cf48/users/93b8284839db4c158d92436fe6499dcb/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:58.466981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78e9a3f85894c91b45b09d9e933cf48, user_id=93b8284839db4c158d92436fe6499dcb, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:58.473390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:58.500931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 909/1823] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:58 2022] PUT /identity/v3/projects/b78e9a3f85894c91b45b09d9e933cf48/users/93b8284839db4c158d92436fe6499dcb/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:58.503261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:58.505265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:58.569486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:58.621115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cabe9-a349-48ce-a71d-3f6f6f30c3e8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:58.625507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8eeff-bebb-4881-a3e9-f31a18d2fdd3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:58.631041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:58.632030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:58.632409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:58.632785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] PATH_INFO: `/v3/users/b7b2baa6bd1a4648a161d5e69c5bbd12` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:58.634322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b2baa6bd1a4648a161d5e69c5bbd12)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:58.650198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:58.653743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:58.654604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:58.655027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:58.655486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:58.656287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:58.658064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:58.672190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 910/1824] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:22:58.675190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:58.688276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781296af-1525-46f4-8a4a-fd8a2f8dd7c5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:58.693453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:58.694120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:58.694457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:58.694733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] PATH_INFO: `/v3/projects/b78e9a3f85894c91b45b09d9e933cf48/users/93b8284839db4c158d92436fe6499dcb/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:58.696791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78e9a3f85894c91b45b09d9e933cf48, user_id=93b8284839db4c158d92436fe6499dcb, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:58.700103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:58.703909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b2baa6bd1a4648a161d5e69c5bbd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.712624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b2baa6bd1a4648a161d5e69c5bbd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.720383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 911/1825] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:22:58 2022] PUT /identity/v3/projects/b78e9a3f85894c91b45b09d9e933cf48/users/93b8284839db4c158d92436fe6499dcb/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:58.730731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b2baa6bd1a4648a161d5e69c5bbd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.731738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b2baa6bd1a4648a161d5e69c5bbd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.732352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-59c00d32-117a-4696-b1f3-a0f98217499d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b2baa6bd1a4648a161d5e69c5bbd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:58.746655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:58.752825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 915/1826] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:22:58 2022] DELETE /identity/v3/users/b7b2baa6bd1a4648a161d5e69c5bbd12 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:59.415361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:59.418472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:59.530129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad425f-7c64-491b-9180-3bf6a4403a8f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:59.601151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:59.602031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:59.602404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:59.602774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] PATH_INFO: `/v3/projects/8abfd9964c5b4becbc5bf68b169c098c` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:59.604646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abfd9964c5b4becbc5bf68b169c098c)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:59.607033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:22:59.673297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abfd9964c5b4becbc5bf68b169c098c', 'request_id': 'req-e557e600-0383-495c-a154-72bad9778dda'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:59.685702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abfd9964c5b4becbc5bf68b169c098c', 'request_id': 'req-e557e600-0383-495c-a154-72bad9778dda'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:59.694671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abfd9964c5b4becbc5bf68b169c098c', 'request_id': 'req-e557e600-0383-495c-a154-72bad9778dda'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:59.704906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:22:59.711830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] The token cache is being invalidate because project 8abfd9964c5b4becbc5bf68b169c098c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:22:59.712847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:59.715451 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e557e600-0383-495c-a154-72bad9778dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:22:59.721610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 912/1827] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:22:59 2022] DELETE /identity/v3/projects/8abfd9964c5b4becbc5bf68b169c098c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:22:59.723685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93587d12-f1ef-430a-84a5-809b80ab8515 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:59.724851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93587d12-f1ef-430a-84a5-809b80ab8515 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:59.725409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93587d12-f1ef-430a-84a5-809b80ab8515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:59.755117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-93587d12-f1ef-430a-84a5-809b80ab8515 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:59.757905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-93587d12-f1ef-430a-84a5-809b80ab8515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:59.897725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 916/1828] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:59.906629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99d9a0-f5d0-4df8-a421-cf908b949190 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:59.906908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99d9a0-f5d0-4df8-a421-cf908b949190 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:59.907182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99d9a0-f5d0-4df8-a421-cf908b949190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:59.938819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8e99d9a0-f5d0-4df8-a421-cf908b949190 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:22:59.940255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8e99d9a0-f5d0-4df8-a421-cf908b949190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:22:59.949195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 913/1829] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:22:59.953349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93587d12-f1ef-430a-84a5-809b80ab8515 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:22:59.964841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93587d12-f1ef-430a-84a5-809b80ab8515 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:22:59.970412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:22:59.971565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:22:59.971984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:22:59.972868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:22:59.973769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:22:59.974217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:22:59.976376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.013952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 917/1830] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:00.018789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99d9a0-f5d0-4df8-a421-cf908b949190 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.031303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99d9a0-f5d0-4df8-a421-cf908b949190 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.037504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.038543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.038924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.039287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.040205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.042910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.074522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 914/1831] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:00 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:00.078506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.093276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f29a8-ce17-48c9-898a-0bc5b308f605 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.183925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.184638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.184968 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.185298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.186004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.188027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.209884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 918/1832] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:00 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:00.214669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.225275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06017-e32a-40c1-8f14-55de3fbb0ce5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.230172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.230812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.231091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.231395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.232036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.233987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.248185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 915/1833] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:00.250005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.260977 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e78bb-bf7f-4105-b7c3-311d94070f4b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.269434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62357311-5b54-4ebd-82b6-072059cd8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.269966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357311-5b54-4ebd-82b6-072059cd8e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.270342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357311-5b54-4ebd-82b6-072059cd8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.270800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357311-5b54-4ebd-82b6-072059cd8e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.271558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62357311-5b54-4ebd-82b6-072059cd8e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.273582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62357311-5b54-4ebd-82b6-072059cd8e39 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.287472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 919/1834] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:00.294650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.317221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd911-d16c-4daa-88ff-f8c7440389cd admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.332579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc841ca-0ecf-42ad-80a8-281bcdebdc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.333507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc841ca-0ecf-42ad-80a8-281bcdebdc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.333824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc841ca-0ecf-42ad-80a8-281bcdebdc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.334080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc841ca-0ecf-42ad-80a8-281bcdebdc87 admin admin] PATH_INFO: `/v3/projects/4d574d44a4c043dca9107b3a7d34218a/users/3dc62e662df048ca8a9fc0bc1006e3ea/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.379557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc841ca-0ecf-42ad-80a8-281bcdebdc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d574d44a4c043dca9107b3a7d34218a, user_id=3dc62e662df048ca8a9fc0bc1006e3ea, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.385643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc841ca-0ecf-42ad-80a8-281bcdebdc87 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.408247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a861ec-8d1b-4a2e-a932-a8d228a99499 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.408547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a861ec-8d1b-4a2e-a932-a8d228a99499 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.408822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a861ec-8d1b-4a2e-a932-a8d228a99499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.420153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 916/1835] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:00 2022] PUT /identity/v3/projects/4d574d44a4c043dca9107b3a7d34218a/users/3dc62e662df048ca8a9fc0bc1006e3ea/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:00.430419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8528-d7f3-40aa-b80e-c30294c8ea3e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.430792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8528-d7f3-40aa-b80e-c30294c8ea3e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.431072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8528-d7f3-40aa-b80e-c30294c8ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.451500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-06a861ec-8d1b-4a2e-a932-a8d228a99499 None None] MFA Rules not processed for user `93b8284839db4c158d92436fe6499dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:00.452847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-06a861ec-8d1b-4a2e-a932-a8d228a99499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:00.474330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a42f8528-d7f3-40aa-b80e-c30294c8ea3e None None] MFA Rules not processed for user `3dc62e662df048ca8a9fc0bc1006e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:00.475994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a42f8528-d7f3-40aa-b80e-c30294c8ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:00.552376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:00.572583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 917/1836] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:00.577815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8528-d7f3-40aa-b80e-c30294c8ea3e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.586501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 920/1837] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:00.681816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8528-d7f3-40aa-b80e-c30294c8ea3e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.687572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.688190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.688471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.689145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.689800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.692150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.735756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 918/1838] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:00 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:00.738886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a861ec-8d1b-4a2e-a932-a8d228a99499 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.755002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a861ec-8d1b-4a2e-a932-a8d228a99499 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.839592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.840222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.840499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.840810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.841687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.843825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.883059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.884893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:00.887712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 921/1839] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:00 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:00.892406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.903645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819b2d-7b56-4897-87d6-baed3d3190c4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.907528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34550b-dcd8-4ff6-8532-6abc1c824a90 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.913625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.914378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.914846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.916983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.916983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.917542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.917895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.918008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] PATH_INFO: `/v3/users/37a1aad7df51440b9e7e8703598d0618` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:00.918992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.919629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a1aad7df51440b9e7e8703598d0618)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:00.921077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.922693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:00.927823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:00.942590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 922/1840] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:00.945128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:00.966881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e7839-e00d-49a8-87a2-c82e68925002 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:00.975731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:00.976437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:00.976884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:00.977347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] PATH_INFO: `/v3/projects/d45427cfa39a445089b10211b2f914dc/users/0e41a5db3c024c9e9664087c6d0a97be/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:01.000223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45427cfa39a445089b10211b2f914dc, user_id=0e41a5db3c024c9e9664087c6d0a97be, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:01.003386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:01.028427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 923/1841] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:00 2022] PUT /identity/v3/projects/d45427cfa39a445089b10211b2f914dc/users/0e41a5db3c024c9e9664087c6d0a97be/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:01.029412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:01.060635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a1aad7df51440b9e7e8703598d0618'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:01.073040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a1aad7df51440b9e7e8703598d0618'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:01.093437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a1aad7df51440b9e7e8703598d0618'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:01.094183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a1aad7df51440b9e7e8703598d0618'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:01.094812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d42617e8-c336-4e3c-8271-c6f105184648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a1aad7df51440b9e7e8703598d0618'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:01.127939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 919/1842] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:00 2022] DELETE /identity/v3/users/37a1aad7df51440b9e7e8703598d0618 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:01.135841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:01.136125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:01.136399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:01.178001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:01.179399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:01.222799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e205040-0640-408d-a705-5e50e672376e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:01.299109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:01.318420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:01.319159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:01.319606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:01.319988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:01.320814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:01.324936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 920/1843] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:01.325045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:01.350162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 924/1844] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:01.354408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:01.356014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:01.358858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:01.361348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:01.383192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e677c-e6fe-443a-8d86-181b7b1143e0 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:01.405578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0abd5-23be-44d9-b374-c31c8d0577ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:01.406276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0abd5-23be-44d9-b374-c31c8d0577ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:01.406558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0abd5-23be-44d9-b374-c31c8d0577ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:01.406837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0abd5-23be-44d9-b374-c31c8d0577ad admin admin] PATH_INFO: `/v3/projects/d45427cfa39a445089b10211b2f914dc/users/0e41a5db3c024c9e9664087c6d0a97be/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:01.411912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0abd5-23be-44d9-b374-c31c8d0577ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45427cfa39a445089b10211b2f914dc, user_id=0e41a5db3c024c9e9664087c6d0a97be, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:01.418488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0abd5-23be-44d9-b374-c31c8d0577ad admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:01.449381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 921/1845] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:01 2022] PUT /identity/v3/projects/d45427cfa39a445089b10211b2f914dc/users/0e41a5db3c024c9e9664087c6d0a97be/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:01.461992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:01.462328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:01.462607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:01.471658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03fc1a-b3ae-4d58-aec6-d820a09cf989 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:01.560470 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:01.561233 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:01.561517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:01.561853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:01.582324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] MFA Rules not processed for user `0e41a5db3c024c9e9664087c6d0a97be`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:01.587414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:01.679156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:01.700679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 922/1846] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:01.716472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:01.718371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:01.718763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:01.722368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:01.732371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 925/1847] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:01.818845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f916d-9063-4026-9a83-7751c98fd25b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:01.823547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:01.824230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:01.824427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:01.824690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:01.836605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:01.838099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:01.860669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 923/1848] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:01.976381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:02.003312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637051-e0f3-4cd0-beca-82a4bc693960 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:02.007594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:02.008529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:02.008807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:02.009108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:02.011162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:02.100222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:02.106429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:02.109296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:02.123038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 926/1849] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:02.472865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:02.476653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:02.503359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d227b03-b1f8-4298-95c0-dbf3e3b67b62 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:02.515225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:02.516401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:02.516683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:02.516954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] PATH_INFO: `/v3/projects/731e7a7c03f24df684b39c256a0f1bfb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:02.518869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731e7a7c03f24df684b39c256a0f1bfb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:02.520858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:02.572209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731e7a7c03f24df684b39c256a0f1bfb', 'request_id': 'req-b29bf954-de5d-4543-bb72-1d9be8564742'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.580538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731e7a7c03f24df684b39c256a0f1bfb', 'request_id': 'req-b29bf954-de5d-4543-bb72-1d9be8564742'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.586209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731e7a7c03f24df684b39c256a0f1bfb', 'request_id': 'req-b29bf954-de5d-4543-bb72-1d9be8564742'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.597966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] The token cache is being invalidate because project 731e7a7c03f24df684b39c256a0f1bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:02.598252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.599065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b29bf954-de5d-4543-bb72-1d9be8564742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.600566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 924/1850] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:02 2022] DELETE /identity/v3/projects/731e7a7c03f24df684b39c256a0f1bfb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:02.604738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:02.615393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d7c2e-ace1-4afe-822f-c86cf52090b3 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:02.675544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:02.676179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:02.676454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:02.676720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] PATH_INFO: `/v3/users/8221e4eb50a44e4583ca340d8c2f2432` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:02.677913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8221e4eb50a44e4583ca340d8c2f2432)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:02.680681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:02.739490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8221e4eb50a44e4583ca340d8c2f2432'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.750848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8221e4eb50a44e4583ca340d8c2f2432'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.771982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8221e4eb50a44e4583ca340d8c2f2432'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.772817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8221e4eb50a44e4583ca340d8c2f2432'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.774227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8221e4eb50a44e4583ca340d8c2f2432'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:02.780813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443de146-f77d-4554-ac2d-4f6caa09e674 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:02.781235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443de146-f77d-4554-ac2d-4f6caa09e674 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:02.781746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443de146-f77d-4554-ac2d-4f6caa09e674 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:02.783091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 925/1851] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:23:02.797616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 927/1852] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:02 2022] DELETE /identity/v3/users/8221e4eb50a44e4583ca340d8c2f2432 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:02.810565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:02.811091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:02.811547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:02.847838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:02.849092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:03.036087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 926/1853] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:03.056104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:03.057730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:03.081356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55c93-5170-4de5-bfcf-a8e3c362ba91 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:03.096491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:03.099713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:03.101808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:03.102234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:03.120843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:03.123719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:03.125522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:03.130861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:03.155523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 928/1854] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:03.166353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:03.252763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481d8c4-e1e2-48cc-b4cf-538835a694ef None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:03.256998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2fcde-0a74-4a24-a44f-be681cacf223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:03.257631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2fcde-0a74-4a24-a44f-be681cacf223 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:03.257910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2fcde-0a74-4a24-a44f-be681cacf223 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:03.258180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2fcde-0a74-4a24-a44f-be681cacf223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:03.261712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e7a2fcde-0a74-4a24-a44f-be681cacf223 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:03.349818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2fcde-0a74-4a24-a44f-be681cacf223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:03.350663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2fcde-0a74-4a24-a44f-be681cacf223 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:03.351886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:03.353929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:03.364899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 927/1855] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:03.497670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7e5ad-dc46-4327-bfbf-7a2e8b690515 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:03.507530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:03.508196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:03.508475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:03.508750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] PATH_INFO: `/v3/projects/a8d22c1090a34ca98726308129d0e3d2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:03.512260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d22c1090a34ca98726308129d0e3d2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:03.514231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:03.516086 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:03.617099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d22c1090a34ca98726308129d0e3d2', 'request_id': 'req-b5ec89d3-7860-41c2-88ad-0647508a64b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:03.629849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d22c1090a34ca98726308129d0e3d2', 'request_id': 'req-b5ec89d3-7860-41c2-88ad-0647508a64b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:03.639991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d22c1090a34ca98726308129d0e3d2', 'request_id': 'req-b5ec89d3-7860-41c2-88ad-0647508a64b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:03.661895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] The token cache is being invalidate because project a8d22c1090a34ca98726308129d0e3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:03.662622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:03.664228 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5ec89d3-7860-41c2-88ad-0647508a64b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:03.673559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 929/1856] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:03 2022] DELETE /identity/v3/projects/a8d22c1090a34ca98726308129d0e3d2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:03.674358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81b272-9c0a-4ea1-898e-aef279204191 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:03.675180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81b272-9c0a-4ea1-898e-aef279204191 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:03.675557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81b272-9c0a-4ea1-898e-aef279204191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:03.704006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1c81b272-9c0a-4ea1-898e-aef279204191 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:03.706957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1c81b272-9c0a-4ea1-898e-aef279204191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:03.804550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 928/1857] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:03.815075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd494-fd77-4ac1-99a3-7901cc60af16 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:03.815450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd494-fd77-4ac1-99a3-7901cc60af16 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:03.815686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd494-fd77-4ac1-99a3-7901cc60af16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:03.862403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c64cd494-fd77-4ac1-99a3-7901cc60af16 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:03.863707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c64cd494-fd77-4ac1-99a3-7901cc60af16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:03.885544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81b272-9c0a-4ea1-898e-aef279204191 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:03.886132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 930/1858] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:03.897999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81b272-9c0a-4ea1-898e-aef279204191 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:03.903279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:03.903938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:03.904217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:03.904491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:03.905144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:03.905499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:03.907238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:03.925083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 929/1859] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:03.930401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cd494-fd77-4ac1-99a3-7901cc60af16 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:03.942999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cd494-fd77-4ac1-99a3-7901cc60af16 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:03.948517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:03.949241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:03.949621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:03.949997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:03.950865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:03.953718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.012817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 931/1860] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:03 2022] POST /identity/v3/projects => generated 401 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:04.016484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.031323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca8c8-f8a3-4da0-91a5-3a1d00e65dfa admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.122022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:04.130855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.131613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.131963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.132313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.133043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.135921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.191596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 930/1861] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:04 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:04.191731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.222435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90281374-b87f-4bd3-a105-4d225bdbc879 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.228484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.229895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.230294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.230810 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.232225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.234056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.263671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 932/1862] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:04.264291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.266261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1caa9-4e90-4f0d-bae2-351f850d360e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.271276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd28e3-2ce6-41e1-b2c2-b895df2f7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.272158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd28e3-2ce6-41e1-b2c2-b895df2f7d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.272372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd28e3-2ce6-41e1-b2c2-b895df2f7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.272683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd28e3-2ce6-41e1-b2c2-b895df2f7d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.273354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd28e3-2ce6-41e1-b2c2-b895df2f7d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.276436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd28e3-2ce6-41e1-b2c2-b895df2f7d2b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.290906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 931/1863] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:04.295758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.309064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072c43-a474-46cd-88e1-903bbd9f9c52 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.325478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.325478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.325478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.325478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] PATH_INFO: `/v3/projects/eec175f9886c4a618685728dc67b02cd/users/a01f404973ce43f692c777a914949761/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.343791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec175f9886c4a618685728dc67b02cd, user_id=a01f404973ce43f692c777a914949761, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.346967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.365480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 933/1864] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:04 2022] PUT /identity/v3/projects/eec175f9886c4a618685728dc67b02cd/users/a01f404973ce43f692c777a914949761/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:04.377208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45ca5-fb6b-4b0e-a7e4-5ade875c2d99 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.377524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45ca5-fb6b-4b0e-a7e4-5ade875c2d99 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.377752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45ca5-fb6b-4b0e-a7e4-5ade875c2d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.431303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1dc45ca5-fb6b-4b0e-a7e4-5ade875c2d99 None None] MFA Rules not processed for user `a01f404973ce43f692c777a914949761`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:04.432622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1dc45ca5-fb6b-4b0e-a7e4-5ade875c2d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:04.565334 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 932/1865] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:04 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:04.570166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.690144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040687-0010-4f54-a7c5-2af086db8860 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.700435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb01ebb-6148-4120-bb48-0bb3b872b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.701007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb01ebb-6148-4120-bb48-0bb3b872b96a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.701280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb01ebb-6148-4120-bb48-0bb3b872b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.701605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb01ebb-6148-4120-bb48-0bb3b872b96a admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.702226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb01ebb-6148-4120-bb48-0bb3b872b96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.704309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb01ebb-6148-4120-bb48-0bb3b872b96a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.745406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 934/1866] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:04 2022] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:04.749214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc45ca5-fb6b-4b0e-a7e4-5ade875c2d99 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.761948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc45ca5-fb6b-4b0e-a7e4-5ade875c2d99 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.765926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ccc0-2821-452f-8830-eb40099df62b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.766152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ccc0-2821-452f-8830-eb40099df62b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.766424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ccc0-2821-452f-8830-eb40099df62b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.768047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 935/1867] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:23:04.776760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d760-d490-4698-9a26-8f44fcdb72b3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.777034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d760-d490-4698-9a26-8f44fcdb72b3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.777324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d760-d490-4698-9a26-8f44fcdb72b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.797117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-52e1d760-d490-4698-9a26-8f44fcdb72b3 None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:04.799079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-52e1d760-d490-4698-9a26-8f44fcdb72b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:04.805404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:04.850455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.851552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.851715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.852102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.852948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.861102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.900077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 933/1868] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:04 2022] POST /identity/v3/users => generated 307 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:04.901667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.903389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:04.917377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c3b09-1dfd-458e-99dc-1257e93c4679 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.924558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.925226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.926099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.926362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] PATH_INFO: `/v3/users/accdb30a12dd41d39d378afc25a80019` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.927620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] RBAC: Authorizing `identity:delete_user(user_id=accdb30a12dd41d39d378afc25a80019)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.929808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.935621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 936/1869] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:23:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:04.936800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d760-d490-4698-9a26-8f44fcdb72b3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.952096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d760-d490-4698-9a26-8f44fcdb72b3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:04.958141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:04.958994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:04.959432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:04.959828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:04.960781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:04.963983 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:04.985210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 937/1870] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:04.990042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:04.991848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:04.992076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accdb30a12dd41d39d378afc25a80019'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:04.995293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:05.003683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accdb30a12dd41d39d378afc25a80019'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.015216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb76c6-de41-4d2b-b268-0694aa3b0fa4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:05.022666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accdb30a12dd41d39d378afc25a80019'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.023340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accdb30a12dd41d39d378afc25a80019'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.024082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accdb30a12dd41d39d378afc25a80019'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.025902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:05.026739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.027181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.027490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.029376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.049665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 934/1871] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:04 2022] DELETE /identity/v3/users/accdb30a12dd41d39d378afc25a80019 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:05.050492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:05.053022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:05.053255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.054928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:05.065495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 938/1872] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:05.150302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dc3b3-a1d0-419c-8d07-e5deb2f0041a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:05.155034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:05.155725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.156019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.156271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] PATH_INFO: `/v3/projects/9252ec9ae49842fbbb3e84f9490295e8/users/ec315f756c754609904461a338f373cf/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.170839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9252ec9ae49842fbbb3e84f9490295e8, user_id=ec315f756c754609904461a338f373cf, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:05.173557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:05.187612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 935/1873] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:05 2022] PUT /identity/v3/projects/9252ec9ae49842fbbb3e84f9490295e8/users/ec315f756c754609904461a338f373cf/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:05.191414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:05.203246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf258d4b-ac0b-44dd-b6b7-cf3393567ff2 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:05.251660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:05.255441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.276626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:05.277630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.277924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.278199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.279662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:05.281479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:05.297200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 939/1874] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:05.300967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:05.303659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.320222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7446846-9ce0-4f5d-ba1a-908fa1000517 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:05.325806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:05.326444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.326721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.327274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] PATH_INFO: `/v3/projects/5428ae5edbe3496f8d2f30aa711fa15e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.329536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5428ae5edbe3496f8d2f30aa711fa15e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:05.332188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:05.344663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f25e9-49c5-47be-a81e-a780bb8f5ae9 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:05.350619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:05.351453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.351788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.352073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] PATH_INFO: `/v3/users/3dc62e662df048ca8a9fc0bc1006e3ea` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.354149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc62e662df048ca8a9fc0bc1006e3ea)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:05.355787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:05.390383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5428ae5edbe3496f8d2f30aa711fa15e', 'request_id': 'req-c4d467dc-844c-47c6-9998-41d0208079f9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.399610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5428ae5edbe3496f8d2f30aa711fa15e', 'request_id': 'req-c4d467dc-844c-47c6-9998-41d0208079f9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.407858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5428ae5edbe3496f8d2f30aa711fa15e', 'request_id': 'req-c4d467dc-844c-47c6-9998-41d0208079f9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.416588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc62e662df048ca8a9fc0bc1006e3ea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.422111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:05.423183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] The token cache is being invalidate because project 5428ae5edbe3496f8d2f30aa711fa15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:05.423512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.424227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.425793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 940/1875] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:05 2022] DELETE /identity/v3/projects/5428ae5edbe3496f8d2f30aa711fa15e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:05.426448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:05.426744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc62e662df048ca8a9fc0bc1006e3ea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.427824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.434630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:05.444442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc62e662df048ca8a9fc0bc1006e3ea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.445488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc62e662df048ca8a9fc0bc1006e3ea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.446884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc62e662df048ca8a9fc0bc1006e3ea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.463443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 936/1876] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:05 2022] DELETE /identity/v3/users/3dc62e662df048ca8a9fc0bc1006e3ea => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:05.467655 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:05.469606 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.514411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d467dc-844c-47c6-9998-41d0208079f9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:05.558122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcf930-ef5b-4642-98c4-5421ef466499 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:05.564033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:05.564867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.565311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.565769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] PATH_INFO: `/v3/users/93b8284839db4c158d92436fe6499dcb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.567116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b8284839db4c158d92436fe6499dcb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:05.569841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:05.596468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c336e2-4f14-4656-ae20-410919fec658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:05.597676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c336e2-4f14-4656-ae20-410919fec658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.597676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c336e2-4f14-4656-ae20-410919fec658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.597886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c336e2-4f14-4656-ae20-410919fec658 admin admin] PATH_INFO: `/v3/projects/9252ec9ae49842fbbb3e84f9490295e8/users/ec315f756c754609904461a338f373cf/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.600105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c336e2-4f14-4656-ae20-410919fec658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9252ec9ae49842fbbb3e84f9490295e8, user_id=ec315f756c754609904461a338f373cf, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:05.604114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c336e2-4f14-4656-ae20-410919fec658 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:05.617063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 941/1877] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:05 2022] PUT /identity/v3/projects/9252ec9ae49842fbbb3e84f9490295e8/users/ec315f756c754609904461a338f373cf/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:05.618964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11bdc-b4a1-43e6-9d4e-bb446c5e9937 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.619840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11bdc-b4a1-43e6-9d4e-bb446c5e9937 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.620529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11bdc-b4a1-43e6-9d4e-bb446c5e9937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.651554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b8284839db4c158d92436fe6499dcb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.660757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b8284839db4c158d92436fe6499dcb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.681089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-83b11bdc-b4a1-43e6-9d4e-bb446c5e9937 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:05.684816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-83b11bdc-b4a1-43e6-9d4e-bb446c5e9937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.687638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b8284839db4c158d92436fe6499dcb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.688557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b8284839db4c158d92436fe6499dcb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.690607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-677c9090-ed02-4095-9088-6c82a97459e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b8284839db4c158d92436fe6499dcb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:05.712351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 937/1878] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:05 2022] DELETE /identity/v3/users/93b8284839db4c158d92436fe6499dcb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:05.714838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.715249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.715556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.785669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] MFA Rules not processed for user `ec315f756c754609904461a338f373cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:05.787153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.828160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 942/1879] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:05.835882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae809f9e-c22c-40d5-9788-f1bf7192eceb None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.836212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae809f9e-c22c-40d5-9788-f1bf7192eceb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.836501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae809f9e-c22c-40d5-9788-f1bf7192eceb None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.840036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 943/1880] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:23:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:23:05.849813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:05.850155 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:05.850428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:05.901187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:05.904663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:05.923560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:05.995460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 938/1881] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:05 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:06.001329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:06.005903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.063625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:06.106116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 944/1882] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:23:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:06.107195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:06.109088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.117403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984583f-a231-41db-b2b4-7ca7712f60d3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:06.122971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:06.124797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.125206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.125491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.216743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b428-b17f-45ff-b758-69e2205c8bc9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:06.227016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:06.228026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.229539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.229970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.231049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:06.233946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:06.249494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 939/1883] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:06.254577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:06.256117 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.257938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:06.261599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:06.270598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fd7f8-cd79-4352-940c-3f2b89b9601f service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:06.283437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:06.285472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.285934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.286845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] PATH_INFO: `/v3/projects/b78e9a3f85894c91b45b09d9e933cf48` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.289632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78e9a3f85894c91b45b09d9e933cf48)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:06.291754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 945/1884] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:06.292909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:06.305880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.313820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:06.370891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0f2f7-d82b-4dbc-8515-8bdc777919d7 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:06.390023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:06.390906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.391187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.391489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.416920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:06.418582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:06.459865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 946/1885] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:06.460180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78e9a3f85894c91b45b09d9e933cf48', 'request_id': 'req-2565a45e-d68a-420c-bc6a-1e13220f2de1'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.460745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:06.466234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.476923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78e9a3f85894c91b45b09d9e933cf48', 'request_id': 'req-2565a45e-d68a-420c-bc6a-1e13220f2de1'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.489736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78e9a3f85894c91b45b09d9e933cf48', 'request_id': 'req-2565a45e-d68a-420c-bc6a-1e13220f2de1'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.500816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84677b21-1595-4c34-92e6-31b176622997 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:06.527683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] The token cache is being invalidate because project b78e9a3f85894c91b45b09d9e933cf48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:06.527980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.528780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.531191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 940/1886] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:06 2022] DELETE /identity/v3/projects/b78e9a3f85894c91b45b09d9e933cf48 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:06.535492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:06.539247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.563517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:06.615649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:06.619557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.619927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.620425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] PATH_INFO: `/v3/users/b39122176f7940f3bbf7b2a4c0ae0373` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.623014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39122176f7940f3bbf7b2a4c0ae0373)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:06.628380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:06.678315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565a45e-d68a-420c-bc6a-1e13220f2de1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:06.694141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a1dfc-7902-4ddd-b797-a2d4d17f5ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:06.694966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a1dfc-7902-4ddd-b797-a2d4d17f5ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.696979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a1dfc-7902-4ddd-b797-a2d4d17f5ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.697355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a1dfc-7902-4ddd-b797-a2d4d17f5ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.701895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fc5a1dfc-7902-4ddd-b797-a2d4d17f5ff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.717783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39122176f7940f3bbf7b2a4c0ae0373'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.728181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39122176f7940f3bbf7b2a4c0ae0373'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.740283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:06.747167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39122176f7940f3bbf7b2a4c0ae0373'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.750095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39122176f7940f3bbf7b2a4c0ae0373'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.750965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d240e7b8-75c7-4d9d-96d7-8a441d0e3422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39122176f7940f3bbf7b2a4c0ae0373'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:06.790596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 947/1887] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:06 2022] DELETE /identity/v3/users/b39122176f7940f3bbf7b2a4c0ae0373 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:06.790596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a2e1f-a7d5-4c77-a9b2-def3ec5a7818 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.790596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a2e1f-a7d5-4c77-a9b2-def3ec5a7818 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.790596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a2e1f-a7d5-4c77-a9b2-def3ec5a7818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.809476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a1dfc-7902-4ddd-b797-a2d4d17f5ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:06.811256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a1dfc-7902-4ddd-b797-a2d4d17f5ff6 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:06.822188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-926a2e1f-a7d5-4c77-a9b2-def3ec5a7818 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:06.823343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 941/1888] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:06 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:06.824133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-926a2e1f-a7d5-4c77-a9b2-def3ec5a7818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.840048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.840337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.840614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.879138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:06.881700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.903520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 948/1889] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:06.912336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7c4c-daa4-485e-a284-1eb528f2d52e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:06.913172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7c4c-daa4-485e-a284-1eb528f2d52e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:06.914066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7c4c-daa4-485e-a284-1eb528f2d52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:06.952628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-983e7c4c-daa4-485e-a284-1eb528f2d52e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:06.955190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-983e7c4c-daa4-485e-a284-1eb528f2d52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.956549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 942/1890] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:06.972364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:06.974041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:06.977866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 949/1891] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:06.979876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7c4c-daa4-485e-a284-1eb528f2d52e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.004561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7c4c-daa4-485e-a284-1eb528f2d52e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.011235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.012073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.012848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.013131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.013797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:07.014099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.015817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.034257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 950/1892] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:07.036080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.040596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:07.096317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae8b23-db53-4560-855b-85b3a9406554 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.105993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.107172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.107172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.107172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] PATH_INFO: `/v3/projects/4d574d44a4c043dca9107b3a7d34218a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.111211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d574d44a4c043dca9107b3a7d34218a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.113231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.159806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2353896-bd8a-4c90-a1e0-02791280e071 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.165134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.166963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.167572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.168090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.188353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.190952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.204864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 943/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:07.206127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.215292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:07.222581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fc067-95e9-4774-963d-1ecbf96e4126 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.282548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d574d44a4c043dca9107b3a7d34218a', 'request_id': 'req-69e68603-a682-467e-8df0-44bc5428caf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.314103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d574d44a4c043dca9107b3a7d34218a', 'request_id': 'req-69e68603-a682-467e-8df0-44bc5428caf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.341389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d574d44a4c043dca9107b3a7d34218a', 'request_id': 'req-69e68603-a682-467e-8df0-44bc5428caf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.351046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.356150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.356720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.357544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.358411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.362482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.364198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] The token cache is being invalidate because project 4d574d44a4c043dca9107b3a7d34218a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:07.364497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.366449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.372491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 951/1894] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:07 2022] DELETE /identity/v3/projects/4d574d44a4c043dca9107b3a7d34218a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:07.376564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.380917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:07.406307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e68603-a682-467e-8df0-44bc5428caf8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.413727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 944/1895] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:07 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:07.413949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.414618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.414898 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.415173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] PATH_INFO: `/v3/users/0e41a5db3c024c9e9664087c6d0a97be` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.417617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e41a5db3c024c9e9664087c6d0a97be)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.418783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.420903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.421286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:07.541395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:07.546775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e41a5db3c024c9e9664087c6d0a97be'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.563116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e41a5db3c024c9e9664087c6d0a97be'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.578979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e41a5db3c024c9e9664087c6d0a97be'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.579854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e41a5db3c024c9e9664087c6d0a97be'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.580548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e41a5db3c024c9e9664087c6d0a97be'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.590325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fb57-0ad5-4c4d-a287-4abfa54074ff admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.598699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.599830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.600214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.600538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.601245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.603891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.627399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 952/1896] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:07 2022] DELETE /identity/v3/users/0e41a5db3c024c9e9664087c6d0a97be => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:07.642701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 945/1897] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:07 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:07.647497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.649442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:07.769302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a6662-5ce5-44fe-9cf1-7347bd15c909 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.777532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.778639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.778991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.779235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.783173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.784747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.814095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.817682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:07.824194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 953/1898] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:07.828678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.842083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149f8b3-cc86-4522-8aa2-e24b0221b8dd admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.848148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.849116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.849394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.849675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] PATH_INFO: `/v3/projects/3299ee2164b54d339800191409e19bad` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.850975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3299ee2164b54d339800191409e19bad)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.853817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.869071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caf44e-63eb-4b58-97a2-90bda6c72877 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.885103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:07.885783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:07.886278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:07.887038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:07.887957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:07.891338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:07.919407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 954/1899] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:07.925224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.936731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3299ee2164b54d339800191409e19bad', 'request_id': 'req-248277f8-681f-42c0-9e82-939daab8a42f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.946081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3299ee2164b54d339800191409e19bad', 'request_id': 'req-248277f8-681f-42c0-9e82-939daab8a42f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.948785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d7b80-2859-4c9d-ad47-f0ea57f1759b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:07.954746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3299ee2164b54d339800191409e19bad', 'request_id': 'req-248277f8-681f-42c0-9e82-939daab8a42f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.969986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] The token cache is being invalidate because project 3299ee2164b54d339800191409e19bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:07.970279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.971400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:07.975411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 946/1900] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:07 2022] DELETE /identity/v3/projects/3299ee2164b54d339800191409e19bad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:07.977130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:07.980020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:08.000309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:08.050297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.051063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.051725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.051725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] PATH_INFO: `/v3/projects/46eb684f7fb948f6ad0dcd228ac599ff/users/1b31fe358f0e4cad8efc9ce7483fc1e9/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.069149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=46eb684f7fb948f6ad0dcd228ac599ff, user_id=1b31fe358f0e4cad8efc9ce7483fc1e9, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.072901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.081368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248277f8-681f-42c0-9e82-939daab8a42f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.092118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 955/1901] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:07 2022] PUT /identity/v3/projects/46eb684f7fb948f6ad0dcd228ac599ff/users/1b31fe358f0e4cad8efc9ce7483fc1e9/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:08.092118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.099447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:08.137268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:08.143738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.144580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.144826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.145105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] PATH_INFO: `/v3/users/abc9bb3227924762878346ffcf415c6e` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.148640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc9bb3227924762878346ffcf415c6e)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.148640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.176133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3c02-b745-498f-9722-5bba44cdaebf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.181479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.182195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.182558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.182833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] PATH_INFO: `/v3/projects/d45427cfa39a445089b10211b2f914dc` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.184253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45427cfa39a445089b10211b2f914dc)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.186289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.199662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc9bb3227924762878346ffcf415c6e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.206601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc9bb3227924762878346ffcf415c6e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.221272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc9bb3227924762878346ffcf415c6e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.222591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc9bb3227924762878346ffcf415c6e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.223225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4ad9a63f-3186-4843-a818-0a18d2ba051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc9bb3227924762878346ffcf415c6e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.239907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45427cfa39a445089b10211b2f914dc', 'request_id': 'req-d3b95601-5097-463b-b110-640b2b49e9f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.245771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 947/1902] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:07 2022] DELETE /identity/v3/users/abc9bb3227924762878346ffcf415c6e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:08.247125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.247424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.247749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.263330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45427cfa39a445089b10211b2f914dc', 'request_id': 'req-d3b95601-5097-463b-b110-640b2b49e9f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.282269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] MFA Rules not processed for user `1b31fe358f0e4cad8efc9ce7483fc1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:08.283545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:08.285984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45427cfa39a445089b10211b2f914dc', 'request_id': 'req-d3b95601-5097-463b-b110-640b2b49e9f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.302350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] The token cache is being invalidate because project d45427cfa39a445089b10211b2f914dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:08.302667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.303415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3b95601-5097-463b-b110-640b2b49e9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:08.305618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 956/1903] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:08 2022] DELETE /identity/v3/projects/d45427cfa39a445089b10211b2f914dc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:08.310586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608e580-8bb3-446a-8f6f-5c90e5d14d60 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.310879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608e580-8bb3-446a-8f6f-5c90e5d14d60 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.311129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608e580-8bb3-446a-8f6f-5c90e5d14d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.313731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:08.344191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5608e580-8bb3-446a-8f6f-5c90e5d14d60 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:08.345435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5608e580-8bb3-446a-8f6f-5c90e5d14d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:08.385442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 948/1904] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:08.390819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.392174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:08.436402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 957/1905] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:08.446395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127417e6-58eb-447a-9c05-b0ea471298c4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.446752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127417e6-58eb-447a-9c05-b0ea471298c4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.447832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127417e6-58eb-447a-9c05-b0ea471298c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.516886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-127417e6-58eb-447a-9c05-b0ea471298c4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:08.519018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f08ff1-edd0-41be-8985-ddb51f9c6490 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.520206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-127417e6-58eb-447a-9c05-b0ea471298c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:08.524240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.525023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.526209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.526625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.527501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.529927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.544757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 958/1906] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 06 04:23:08.557325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127417e6-58eb-447a-9c05-b0ea471298c4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.568757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 949/1907] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:08 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:08.569949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.575652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127417e6-58eb-447a-9c05-b0ea471298c4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.677134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174fc07-5eb6-4080-8e11-b7c9efc0c4fe admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.687108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.689133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.689472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.692984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.693778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.696981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.701015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:08.720312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.721917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.722363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.722868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.725139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:08.725603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.727689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.730049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 950/1908] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:08 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:08.731075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.742818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 959/1909] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:23:08.743019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d4d2-7bc2-41d4-ac80-2d5db3c6bbd2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.747831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.749622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.750557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.750840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.751110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.753393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.753393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.764539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48575239-048a-4960-b9eb-1885ff59191a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.775633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 951/1910] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:08.779539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.780369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.780713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.781209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.781656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.782544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.784784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.817414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7209d77-23c0-4367-87f0-a08e02f29069 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:08.837183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:08.839015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:08.840184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:08.841497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] PATH_INFO: `/v3/projects/11584bb5fb784c2eb386e00a9ce68a27/users/528d869011f44b21884df70bdda62b67/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:08.848933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 960/1911] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:08 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:08.851963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:08.883348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11584bb5fb784c2eb386e00a9ce68a27, user_id=528d869011f44b21884df70bdda62b67, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:08.887062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:08.906822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:08.922203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 952/1912] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:08 2022] PUT /identity/v3/projects/11584bb5fb784c2eb386e00a9ce68a27/users/528d869011f44b21884df70bdda62b67/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:08.924461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.057861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ff0a1-0f25-461f-be6f-437ee804ad7e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.062488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b871ff0-ea5b-4bee-8495-bea6c6980f63 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.067608 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.067917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.068280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.068563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.068875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.069089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.069372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.069572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.069670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.070361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.071809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.072045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.083215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 953/1913] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:09.085870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.088595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.103023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bdde1-c0f8-414e-977b-739ecaa75cd7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.108492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.108772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 961/1914] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:08 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:09.109129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.109404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.109582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.109706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] PATH_INFO: `/v3/projects/4929ef41a60b42a184a1cbce51e6bb87` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.110777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=4929ef41a60b42a184a1cbce51e6bb87)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.112766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.120277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5472-d7b0-4d69-936a-c5a83b9b25d5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.125169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.125815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.126091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.126367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] PATH_INFO: `/v3/projects/11584bb5fb784c2eb386e00a9ce68a27/users/528d869011f44b21884df70bdda62b67/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.128352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11584bb5fb784c2eb386e00a9ce68a27, user_id=528d869011f44b21884df70bdda62b67, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.131029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.151704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 962/1915] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:09 2022] PUT /identity/v3/projects/11584bb5fb784c2eb386e00a9ce68a27/users/528d869011f44b21884df70bdda62b67/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:09.151704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.165222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4929ef41a60b42a184a1cbce51e6bb87', 'request_id': 'req-5d97ac99-6099-4597-b50c-e7826d688cde'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.173779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4929ef41a60b42a184a1cbce51e6bb87', 'request_id': 'req-5d97ac99-6099-4597-b50c-e7826d688cde'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.179670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4929ef41a60b42a184a1cbce51e6bb87', 'request_id': 'req-5d97ac99-6099-4597-b50c-e7826d688cde'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.191855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] The token cache is being invalidate because project 4929ef41a60b42a184a1cbce51e6bb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:09.192145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.192891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5d97ac99-6099-4597-b50c-e7826d688cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.194628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 954/1916] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:09 2022] DELETE /identity/v3/projects/4929ef41a60b42a184a1cbce51e6bb87 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:09.196914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.197565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.198064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.209693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba585541-90ab-47cd-b071-c380fef749f0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.227265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] MFA Rules not processed for user `528d869011f44b21884df70bdda62b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:09.228556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.254242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:09.268587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.269206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.269519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.269791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.270436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.272081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.282859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 963/1917] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:09.283856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.285595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.297709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff94a7-fbb6-42e4-90ad-f86094eba535 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.298520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 955/1918] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:09.299588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.301247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.303733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.304401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.304679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.305051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] PATH_INFO: `/v3/users/5048b4cdb1a84501928fbc602da00ce9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.306083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5048b4cdb1a84501928fbc602da00ce9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.308072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.309264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:09.315363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa90aa-7361-4003-9f32-ff33918f4aea None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.321386 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.322697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.323434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.323950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.324913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.327666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.338960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 956/1919] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:09.339784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.341421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.359027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5048b4cdb1a84501928fbc602da00ce9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.365785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5048b4cdb1a84501928fbc602da00ce9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.378542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5048b4cdb1a84501928fbc602da00ce9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.379562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5048b4cdb1a84501928fbc602da00ce9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.380442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5048b4cdb1a84501928fbc602da00ce9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:09.396223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 964/1920] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:09 2022] DELETE /identity/v3/users/5048b4cdb1a84501928fbc602da00ce9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:09.399401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.399754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.402241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351a38d-1c3b-44c6-a587-b15f0c53a9fe admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.457000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd8dd7-5f0f-448e-9dcd-905a27428bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.457650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd8dd7-5f0f-448e-9dcd-905a27428bfc service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.457929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd8dd7-5f0f-448e-9dcd-905a27428bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.458200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd8dd7-5f0f-448e-9dcd-905a27428bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.460287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-04cd8dd7-5f0f-448e-9dcd-905a27428bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.515521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6698b1b-6503-4043-9aa5-7d38984d1df5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.547452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.548138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.548415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.548686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] PATH_INFO: `/v3/projects/26317b958de44018a59715732ee2b322/users/e1d17cc936e54964bb382f07a96e2acf/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.554378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd8dd7-5f0f-448e-9dcd-905a27428bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.556208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd8dd7-5f0f-448e-9dcd-905a27428bfc service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.569495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 957/1921] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:09.578870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26317b958de44018a59715732ee2b322, user_id=e1d17cc936e54964bb382f07a96e2acf, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.582993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.608857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 965/1922] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:09 2022] PUT /identity/v3/projects/26317b958de44018a59715732ee2b322/users/e1d17cc936e54964bb382f07a96e2acf/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:09.620725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896ecd-5973-4f14-97de-6470f10d9eef None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.621104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896ecd-5973-4f14-97de-6470f10d9eef None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.621387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896ecd-5973-4f14-97de-6470f10d9eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.667911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-cb896ecd-5973-4f14-97de-6470f10d9eef None None] MFA Rules not processed for user `e1d17cc936e54964bb382f07a96e2acf`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:09.669249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cb896ecd-5973-4f14-97de-6470f10d9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.705006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.706836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.746822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:09.793439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 958/1923] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:09.796593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:09.798278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896ecd-5973-4f14-97de-6470f10d9eef None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:09.847969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05869162-bc2d-4078-bad8-47af987e5a56 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.860866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.863562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.864074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.865350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.874341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:09.955918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896ecd-5973-4f14-97de-6470f10d9eef None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:09.961627 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:09.962451 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:09.963663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:09.963940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:09.964882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.966857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:09.975073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:09.977187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.007678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 959/1924] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:09 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:10.008394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.012218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 966/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:10.113453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.115221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:10.143307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247612-bbbc-40ef-9d25-50b497afc8ec admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.149101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba219-9370-448f-881c-78ffb2aada1e service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.160670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.162360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.162550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.163087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.163210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.163481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.163818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] PATH_INFO: `/v3/projects/01deaff9711b4d0081c1c35ae433f996` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.163946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.164507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.165447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=01deaff9711b4d0081c1c35ae433f996)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.167139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.168608 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.233219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 960/1926] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:10 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:10.247356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.270084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01deaff9711b4d0081c1c35ae433f996', 'request_id': 'req-221cf378-263f-4462-b9f1-a1d09fa597fd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:10.287996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace86c-f031-44c4-b508-ad50be4ffa5b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.292287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01deaff9711b4d0081c1c35ae433f996', 'request_id': 'req-221cf378-263f-4462-b9f1-a1d09fa597fd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:10.307858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01deaff9711b4d0081c1c35ae433f996', 'request_id': 'req-221cf378-263f-4462-b9f1-a1d09fa597fd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:10.339155 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] The token cache is being invalidate because project 01deaff9711b4d0081c1c35ae433f996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:10.339155 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:10.339155 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-221cf378-263f-4462-b9f1-a1d09fa597fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:10.342003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 967/1927] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:10 2022] DELETE /identity/v3/projects/01deaff9711b4d0081c1c35ae433f996 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:10.344033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c15779-55a3-48c4-b11b-8ffdc7cb5e12 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.344300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c15779-55a3-48c4-b11b-8ffdc7cb5e12 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.344574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c15779-55a3-48c4-b11b-8ffdc7cb5e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.389787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-82c15779-55a3-48c4-b11b-8ffdc7cb5e12 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:10.391146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-82c15779-55a3-48c4-b11b-8ffdc7cb5e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:10.414658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.415807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.416106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.416380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.417086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.418854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.421780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:10.443789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 961/1928] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:10.449669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.452027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:10.469926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913bdca-e150-46be-a769-5d044254c6d9 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.473497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 968/1929] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:10.482326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.483031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.483306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.483435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf249c-449e-4be3-99d7-8608946c0a6d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.483700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] PATH_INFO: `/v3/projects/768c9341970047cfa4fc6a5d37b3bddd/users/62467fe2a9624168be06eb27dc16ec33/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.483886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf249c-449e-4be3-99d7-8608946c0a6d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.484170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf249c-449e-4be3-99d7-8608946c0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.507391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=768c9341970047cfa4fc6a5d37b3bddd, user_id=62467fe2a9624168be06eb27dc16ec33, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.511284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.530058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ddbf249c-449e-4be3-99d7-8608946c0a6d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:10.531307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ddbf249c-449e-4be3-99d7-8608946c0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:10.536013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 962/1930] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:10 2022] PUT /identity/v3/projects/768c9341970047cfa4fc6a5d37b3bddd/users/62467fe2a9624168be06eb27dc16ec33/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:10.540576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.551819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:10.610359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7b523-fe73-4244-a32a-529dc950d81f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.611910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 969/1931] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:10.615464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.616164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf249c-449e-4be3-99d7-8608946c0a6d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.616287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.616610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.616945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.617911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.624514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.626012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf249c-449e-4be3-99d7-8608946c0a6d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.631252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.631883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.632829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.633116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.633755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:10.634066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.636306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.637623 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 963/1932] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:10.641697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.654208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 970/1933] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:10.657130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8e7d-2200-4255-bb68-e80ddd5c72bb admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.658557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.662801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ab791-a011-40d0-877c-876869bdec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.663489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab791-a011-40d0-877c-876869bdec42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.663769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab791-a011-40d0-877c-876869bdec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.664122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab791-a011-40d0-877c-876869bdec42 admin admin] PATH_INFO: `/v3/projects/768c9341970047cfa4fc6a5d37b3bddd/users/62467fe2a9624168be06eb27dc16ec33/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.666180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ab791-a011-40d0-877c-876869bdec42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768c9341970047cfa4fc6a5d37b3bddd, user_id=62467fe2a9624168be06eb27dc16ec33, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.669091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ab791-a011-40d0-877c-876869bdec42 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.669223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abfffe-9e54-4b48-ade7-6bc38a202656 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.673870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.674454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.674758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.675027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.675688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.677789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.680423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 964/1934] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:10 2022] PUT /identity/v3/projects/768c9341970047cfa4fc6a5d37b3bddd/users/62467fe2a9624168be06eb27dc16ec33/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:10.691096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.691420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.691713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.710146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 971/1935] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:10 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:10.714942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.722804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] MFA Rules not processed for user `62467fe2a9624168be06eb27dc16ec33`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:10.724040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:10.778237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0603-e28a-4b35-9bfd-468d5d54a5b4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.782804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.783423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.783699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.783964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.784635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.786537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.801198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 965/1936] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:10.809649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 972/1937] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:10 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:10.812748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.813767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.814140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:10.824205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bf48-96a8-47c5-adcb-c4469bf79635 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.828987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.829606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.829884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.830158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.830798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.832427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.846149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 973/1938] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:10.847139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.856613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bb8b8-541f-4636-a87e-8324248daacc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.861122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:10.861246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.861822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.862100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.862374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.863004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.864604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.875633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 974/1939] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:10.876398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741fbd-56f5-40cb-9823-8c744326dd94 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.880022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:10.880574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.881191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.881505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.881779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.883688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:10.892123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9da6-5a47-4dd2-8a70-18f582cf193b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:10.897236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f166fa-4f1d-48fd-a44b-3c0a9d64ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:10.898061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f166fa-4f1d-48fd-a44b-3c0a9d64ec34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.898514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f166fa-4f1d-48fd-a44b-3c0a9d64ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.898934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f166fa-4f1d-48fd-a44b-3c0a9d64ec34 admin admin] PATH_INFO: `/v3/projects/b4f6d8d5a1ca4d6aa0d4efb6c60ab040/users/98b611b2d22e4240a638406c6239c6ad/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.916482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f166fa-4f1d-48fd-a44b-3c0a9d64ec34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f6d8d5a1ca4d6aa0d4efb6c60ab040, user_id=98b611b2d22e4240a638406c6239c6ad, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.919488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f166fa-4f1d-48fd-a44b-3c0a9d64ec34 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.937119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 975/1940] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:10 2022] PUT /identity/v3/projects/b4f6d8d5a1ca4d6aa0d4efb6c60ab040/users/98b611b2d22e4240a638406c6239c6ad/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:10.950847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918bdf-de28-4a0c-9277-fda4b4488783 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:10.951161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918bdf-de28-4a0c-9277-fda4b4488783 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:10.951900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918bdf-de28-4a0c-9277-fda4b4488783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:10.964568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:10.966015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:10.976472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 966/1941] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:10.984550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4f918bdf-de28-4a0c-9277-fda4b4488783 None None] MFA Rules not processed for user `98b611b2d22e4240a638406c6239c6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:10.985883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f918bdf-de28-4a0c-9277-fda4b4488783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:11.010934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:11.100348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 976/1942] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:11.105158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:11.120796 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0858aa0-4610-4238-9c14-945706bbcba1 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:11.214201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:11.215735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.216730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.217237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.218132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:11.221237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:11.257129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 967/1943] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:11 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:11.261255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f918bdf-de28-4a0c-9277-fda4b4488783 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:11.273695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f918bdf-de28-4a0c-9277-fda4b4488783 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:11.378222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:11.379240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.379562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.379846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.381808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:11.387620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:11.447653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 977/1944] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:11 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:11.451957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:11.467512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ebdb-ce79-44e4-b9ff-36e9ef186f1b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:11.478636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:11.481608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.482593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.483239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.486198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:11.493257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:11.525880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:11.536736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 968/1945] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:11.537347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37888-f0bf-4e8e-b23a-263952332c4e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:11.542908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:11.544454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.544454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.544454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] PATH_INFO: `/v3/projects/f37f8db2820e48b6aeb1e8d65a08c91e/users/fd1b38d378a8437c9945fe11e324660a/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.564416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37f8db2820e48b6aeb1e8d65a08c91e, user_id=fd1b38d378a8437c9945fe11e324660a, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:11.567742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:11.593509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:11.598961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 978/1946] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:11 2022] PUT /identity/v3/projects/f37f8db2820e48b6aeb1e8d65a08c91e/users/fd1b38d378a8437c9945fe11e324660a/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:11.605024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c0681-5281-4d77-82c3-63eb67fb3178 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:11.737155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58427012-7919-4733-b7f9-5983670a0c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:11.737778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427012-7919-4733-b7f9-5983670a0c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.738057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427012-7919-4733-b7f9-5983670a0c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.738353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427012-7919-4733-b7f9-5983670a0c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.739106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58427012-7919-4733-b7f9-5983670a0c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:11.740953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58427012-7919-4733-b7f9-5983670a0c6f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:11.755226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 969/1947] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:11.759108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:11.772835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afd95d-654d-4807-8f87-d26b4be59b30 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:11.782532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:11.783361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.784736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.786130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] PATH_INFO: `/v3/projects/f37f8db2820e48b6aeb1e8d65a08c91e/users/fd1b38d378a8437c9945fe11e324660a/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.791650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37f8db2820e48b6aeb1e8d65a08c91e, user_id=fd1b38d378a8437c9945fe11e324660a, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:11.798013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:11.823479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 979/1948] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:11 2022] PUT /identity/v3/projects/f37f8db2820e48b6aeb1e8d65a08c91e/users/fd1b38d378a8437c9945fe11e324660a/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:11.835170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274e905-ab61-4b26-bed0-736aabb78ca5 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.835702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274e905-ab61-4b26-bed0-736aabb78ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.836110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274e905-ab61-4b26-bed0-736aabb78ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.849979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:11.857602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:11.869238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:11.889933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9274e905-ab61-4b26-bed0-736aabb78ca5 None None] MFA Rules not processed for user `fd1b38d378a8437c9945fe11e324660a`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:11.892537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9274e905-ab61-4b26-bed0-736aabb78ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:11.954844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2927bb3-1ab1-4dab-9be5-0f18f84e0211 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:11.967432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:11.968392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:11.968998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:11.969261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] PATH_INFO: `/v3/users/a01f404973ce43f692c777a914949761` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:11.971572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01f404973ce43f692c777a914949761)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:11.974985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:11.994474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:12.003092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 970/1949] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:12.010353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274e905-ab61-4b26-bed0-736aabb78ca5 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:12.066870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01f404973ce43f692c777a914949761'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.078356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01f404973ce43f692c777a914949761'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.088688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274e905-ab61-4b26-bed0-736aabb78ca5 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:12.092721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:12.093406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:12.093811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:12.094213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:12.094811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01f404973ce43f692c777a914949761'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.095594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01f404973ce43f692c777a914949761'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.096229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-173da26f-0b53-4348-bb1e-e31a127fc82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01f404973ce43f692c777a914949761'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.108810 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:12.110239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:12.111566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 980/1950] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:11 2022] DELETE /identity/v3/users/a01f404973ce43f692c777a914949761 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:12.115896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:12.116188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:12.116470 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:12.121356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 971/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:12.137732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:12.138954 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:12.206641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 981/1952] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:12.217455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:12.219189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:12.284947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc03e7-2322-4fbe-9d23-254a4e264b72 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:12.342705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:12.343310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:12.343613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:12.343883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:12.350054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:12.354298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:12.355969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:12.365450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 972/1953] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:12.736736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:12.740362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:12.767834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede76c00-e94a-4f57-aae4-9477c8b3461e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:12.774514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:12.775403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:12.775777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:12.776147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] PATH_INFO: `/v3/projects/eec175f9886c4a618685728dc67b02cd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:12.778875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec175f9886c4a618685728dc67b02cd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:12.781772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:12.849702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:12.852299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:12.871158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec175f9886c4a618685728dc67b02cd', 'request_id': 'req-5553d10d-9f6f-44d5-86c0-22522fe72dde'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.872359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3eb05-f556-425c-9df9-2bfbc6dad855 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:12.882767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec175f9886c4a618685728dc67b02cd', 'request_id': 'req-5553d10d-9f6f-44d5-86c0-22522fe72dde'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.910025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec175f9886c4a618685728dc67b02cd', 'request_id': 'req-5553d10d-9f6f-44d5-86c0-22522fe72dde'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.942007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] The token cache is being invalidate because project eec175f9886c4a618685728dc67b02cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:12.942392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.943424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:12.956353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:12.956924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 982/1954] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:12 2022] DELETE /identity/v3/projects/eec175f9886c4a618685728dc67b02cd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:12.958132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:12.958579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:12.958997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] PATH_INFO: `/v3/users/98b611b2d22e4240a638406c6239c6ad` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:12.960714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b611b2d22e4240a638406c6239c6ad)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:12.963400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:12.964009 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:12.964890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:12.994878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d10d-9f6f-44d5-86c0-22522fe72dde admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:13.001211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:13.001637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.001919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.002245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] PATH_INFO: `/v3/users/ec315f756c754609904461a338f373cf` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.003521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec315f756c754609904461a338f373cf)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:13.006144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:13.012889 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:13.068381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b611b2d22e4240a638406c6239c6ad'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.084555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b611b2d22e4240a638406c6239c6ad'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.097202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec315f756c754609904461a338f373cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.114778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec315f756c754609904461a338f373cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.118085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b611b2d22e4240a638406c6239c6ad'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.119621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b611b2d22e4240a638406c6239c6ad'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.121178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-79a78c86-8269-4c14-abd3-58e80ede0b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b611b2d22e4240a638406c6239c6ad'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.148720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec315f756c754609904461a338f373cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.149489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec315f756c754609904461a338f373cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.150857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 973/1955] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:12 2022] DELETE /identity/v3/users/98b611b2d22e4240a638406c6239c6ad => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:13.154482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec315f756c754609904461a338f373cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.157686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.157686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.157962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.178057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 983/1956] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:12 2022] DELETE /identity/v3/users/ec315f756c754609904461a338f373cf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:13.217125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:13.218380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:13.362044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 974/1957] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:13.374947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:13.376485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:13.467299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c889f-4942-4e0f-877b-530e829f3b4f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:13.472625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c049069-d4bc-407b-8124-65c8e78cc785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:13.473486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c049069-d4bc-407b-8124-65c8e78cc785 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.473859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c049069-d4bc-407b-8124-65c8e78cc785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.474271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c049069-d4bc-407b-8124-65c8e78cc785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.485453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c049069-d4bc-407b-8124-65c8e78cc785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:13.487004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c049069-d4bc-407b-8124-65c8e78cc785 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:13.503965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 984/1958] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:13.576660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:13.578092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:13.590649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79221-4f5d-4fce-8c5b-f54c12d5cbbc None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:13.595506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:13.596026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.596484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.596716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] PATH_INFO: `/v3/projects/9252ec9ae49842fbbb3e84f9490295e8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.597866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9252ec9ae49842fbbb3e84f9490295e8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:13.603637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:13.609603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:13.656883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9252ec9ae49842fbbb3e84f9490295e8', 'request_id': 'req-d6829755-3e13-4f82-87c2-087919bdc7d7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.664953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9252ec9ae49842fbbb3e84f9490295e8', 'request_id': 'req-d6829755-3e13-4f82-87c2-087919bdc7d7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.673968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9252ec9ae49842fbbb3e84f9490295e8', 'request_id': 'req-d6829755-3e13-4f82-87c2-087919bdc7d7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.689308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] The token cache is being invalidate because project 9252ec9ae49842fbbb3e84f9490295e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:13.689847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.690563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6829755-3e13-4f82-87c2-087919bdc7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:13.692356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 975/1959] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:13 2022] DELETE /identity/v3/projects/9252ec9ae49842fbbb3e84f9490295e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:13.700076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a00ac-ecef-46e6-bdc9-953a1ceab506 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.700429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a00ac-ecef-46e6-bdc9-953a1ceab506 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.700771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a00ac-ecef-46e6-bdc9-953a1ceab506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.722298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e60a00ac-ecef-46e6-bdc9-953a1ceab506 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:13.723838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e60a00ac-ecef-46e6-bdc9-953a1ceab506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:13.786652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 985/1960] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:13.795008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de444a-bb3e-4f55-b2bd-27aae4eb39e2 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.795270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de444a-bb3e-4f55-b2bd-27aae4eb39e2 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.795630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de444a-bb3e-4f55-b2bd-27aae4eb39e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.816180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-57de444a-bb3e-4f55-b2bd-27aae4eb39e2 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:13.817391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-57de444a-bb3e-4f55-b2bd-27aae4eb39e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:13.825943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 976/1961] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:13.830082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a00ac-ecef-46e6-bdc9-953a1ceab506 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:13.840703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a00ac-ecef-46e6-bdc9-953a1ceab506 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:13.845664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:13.846433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.846544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.846800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.847480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:13.847782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:13.849385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:13.861789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 986/1962] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:13.865989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de444a-bb3e-4f55-b2bd-27aae4eb39e2 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:13.876641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de444a-bb3e-4f55-b2bd-27aae4eb39e2 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:13.897743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:13.897743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:13.897743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:13.897743 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:13.898097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:13.898097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:13.924014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 977/1963] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:13 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:13.924576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:13.947907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f005a15-baf5-4f15-a27c-a083ea087f84 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:13.961362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:13.986319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:13.989568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:14.076220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:14.078340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.079224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.080053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.080857 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:14.084647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:14.121121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 987/1964] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:13 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:14.125181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:14.136410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedc513-9591-4f77-b9af-bc22b0b55009 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:14.137975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad52a0-936e-49ec-b00a-56896a1c9f8b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:14.141621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:14.142357 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.142788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.143158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.143940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:14.145765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:14.148665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:14.149504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.150806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.151257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] PATH_INFO: `/v3/projects/b4f6d8d5a1ca4d6aa0d4efb6c60ab040` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.152594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f6d8d5a1ca4d6aa0d4efb6c60ab040)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:14.155137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:14.167013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 988/1965] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:14.172356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:14.186280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b86c-ee10-4b5e-ba42-ab6190db9700 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:14.196366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:14.197232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.197513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.197796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.198458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:14.207580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:14.229129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f6d8d5a1ca4d6aa0d4efb6c60ab040', 'request_id': 'req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.238244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f6d8d5a1ca4d6aa0d4efb6c60ab040', 'request_id': 'req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.245435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 989/1966] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:14.248050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:14.260959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c25cba-c5f6-4127-a5a8-57b29a45bbb7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:14.270060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f6d8d5a1ca4d6aa0d4efb6c60ab040', 'request_id': 'req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.287131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:14.296507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] The token cache is being invalidate because project b4f6d8d5a1ca4d6aa0d4efb6c60ab040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:14.297079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.297852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.306907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 978/1967] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:13 2022] DELETE /identity/v3/projects/b4f6d8d5a1ca4d6aa0d4efb6c60ab040 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:14.311098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:14.313198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:14.383565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e54d-b406-43ba-8966-af57d2a52371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:14.384450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e54d-b406-43ba-8966-af57d2a52371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.384934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e54d-b406-43ba-8966-af57d2a52371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.385950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e54d-b406-43ba-8966-af57d2a52371 admin admin] PATH_INFO: `/v3/projects/80fdd74529694535a12ca0c275d3baed/users/354a13ba745d4c129a920bc47f390f12/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.406086 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e54d-b406-43ba-8966-af57d2a52371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fdd74529694535a12ca0c275d3baed, user_id=354a13ba745d4c129a920bc47f390f12, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:14.409941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e54d-b406-43ba-8966-af57d2a52371 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:14.463410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 990/1968] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:14 2022] PUT /identity/v3/projects/80fdd74529694535a12ca0c275d3baed/users/354a13ba745d4c129a920bc47f390f12/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:14.469901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.470325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.470694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.499458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fcd37-0e56-4d1b-afd8-13c9092da1d3 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:14.523781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] MFA Rules not processed for user `354a13ba745d4c129a920bc47f390f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:14.525987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:14.605796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:14.627056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 991/1969] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:14.628190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:14.629654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:14.629979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:14.632777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.633054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.633327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] PATH_INFO: `/v3/users/fd1b38d378a8437c9945fe11e324660a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.634656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1b38d378a8437c9945fe11e324660a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:14.636823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:14.654135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9e07d-6085-4bf7-a5d4-aea3e4289b1f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:14.662370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:14.663469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:14.663809 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:14.664225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:14.666826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:14.685287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:14.731458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1b38d378a8437c9945fe11e324660a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.747210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1b38d378a8437c9945fe11e324660a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.757491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 992/1970] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:14 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:14.758374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:14.771175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1b38d378a8437c9945fe11e324660a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.772547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1b38d378a8437c9945fe11e324660a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.773850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1b38d378a8437c9945fe11e324660a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:14.801457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 979/1971] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:14 2022] DELETE /identity/v3/users/fd1b38d378a8437c9945fe11e324660a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:14.898858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77837bc-cf18-4c54-bf8e-fd13a44c1ad4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:15.055096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:15.056976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.057335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.057923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.058415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:15.065416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:15.122101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 993/1972] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:14 2022] POST /identity/v3/users => generated 301 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:15.127619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:15.131648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:15.154382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf79f-88e8-4970-bb33-47391ceb9df7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:15.160578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:15.161543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.161965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.162561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.163694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:15.166529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:15.185897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 980/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:15.187225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:15.201363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ba77-2feb-45fb-a4f1-01f969e9724f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:15.212323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:15.214451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.214740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.216759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] PATH_INFO: `/v3/projects/0f77f16dff1a43c48ddce700e9b7284a/users/a503fd34d6dd47d1884689561abf2ee8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.282632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f77f16dff1a43c48ddce700e9b7284a, user_id=a503fd34d6dd47d1884689561abf2ee8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:15.298297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:15.330121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 994/1974] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:15 2022] PUT /identity/v3/projects/0f77f16dff1a43c48ddce700e9b7284a/users/a503fd34d6dd47d1884689561abf2ee8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:15.331343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:15.347849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca8c8-43b1-4d6b-bd10-07f33e16c339 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:15.393319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:15.459070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:15.461560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:15.491591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:15.492489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.492785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.494946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.495714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:15.499785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:15.538849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:15.540329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 981/1975] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:15.541709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:15.565834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b9c3-81b7-41e8-b723-b2c4027da50d admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:15.577665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443d92b-cd04-4e0e-80bb-7b858c128d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:15.578577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443d92b-cd04-4e0e-80bb-7b858c128d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.579045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443d92b-cd04-4e0e-80bb-7b858c128d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.579511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443d92b-cd04-4e0e-80bb-7b858c128d35 admin admin] PATH_INFO: `/v3/projects/0f77f16dff1a43c48ddce700e9b7284a/users/a503fd34d6dd47d1884689561abf2ee8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.580796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05086d-4bb7-43fd-866c-33e59c19509d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:15.585584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443d92b-cd04-4e0e-80bb-7b858c128d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f77f16dff1a43c48ddce700e9b7284a, user_id=a503fd34d6dd47d1884689561abf2ee8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:15.588494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:15.589884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.590257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.590616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] PATH_INFO: `/v3/projects/f37f8db2820e48b6aeb1e8d65a08c91e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.591049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443d92b-cd04-4e0e-80bb-7b858c128d35 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:15.594050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37f8db2820e48b6aeb1e8d65a08c91e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:15.596334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:15.629955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 982/1976] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:15 2022] PUT /identity/v3/projects/0f77f16dff1a43c48ddce700e9b7284a/users/a503fd34d6dd47d1884689561abf2ee8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:15.647016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763db2e-00ce-45ab-aad4-d3d7b4083da8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.647280 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763db2e-00ce-45ab-aad4-d3d7b4083da8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.647534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763db2e-00ce-45ab-aad4-d3d7b4083da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.686023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37f8db2820e48b6aeb1e8d65a08c91e', 'request_id': 'req-64c661a5-3b79-43a5-8f21-62b4b6719210'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:15.697714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b763db2e-00ce-45ab-aad4-d3d7b4083da8 None None] MFA Rules not processed for user `a503fd34d6dd47d1884689561abf2ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:15.699019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b763db2e-00ce-45ab-aad4-d3d7b4083da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:15.699795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37f8db2820e48b6aeb1e8d65a08c91e', 'request_id': 'req-64c661a5-3b79-43a5-8f21-62b4b6719210'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:15.710222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37f8db2820e48b6aeb1e8d65a08c91e', 'request_id': 'req-64c661a5-3b79-43a5-8f21-62b4b6719210'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:15.732679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] The token cache is being invalidate because project f37f8db2820e48b6aeb1e8d65a08c91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:15.733138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:15.734727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64c661a5-3b79-43a5-8f21-62b4b6719210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:15.739171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 995/1977] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:15 2022] DELETE /identity/v3/projects/f37f8db2820e48b6aeb1e8d65a08c91e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:15.745023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.745519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.745943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.780389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:15.781653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:15.852555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 983/1978] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:15.869864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 996/1979] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:15.872454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:15.873714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e680-3b75-49b9-b887-b228923ab703 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.873989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e680-3b75-49b9-b887-b228923ab703 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.874260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e680-3b75-49b9-b887-b228923ab703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.878243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:15.906266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9075e680-3b75-49b9-b887-b228923ab703 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:15.908015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9075e680-3b75-49b9-b887-b228923ab703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:15.921262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 984/1980] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:15.925618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075e680-3b75-49b9-b887-b228923ab703 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:15.938371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075e680-3b75-49b9-b887-b228923ab703 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:15.957546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:15.960457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:15.962005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:15.963201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:15.965140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:15.966535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:15.969444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:15.993694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 985/1981] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:16.010036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.022219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761c0bb-cdd3-4082-9265-fa9a194d667d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.029913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a65d5-05bb-4ffa-8636-82043997a5d4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.032842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.033475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.033757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.034030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.044324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.045823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.046059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.047649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.048536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.048895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.051075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.059351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.061164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 997/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:16.146224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 986/1983] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:16 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:16.150926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.166961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c4e1-58e6-457f-9546-1d1bbda126a6 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.186097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:16.241171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.243337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:16.306741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.307600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.312201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.317620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.319421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.322213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.361028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:16.376541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 998/1984] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:16 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:16.378698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.387666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:16.396510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b2a3-29f2-4a82-bcfe-f75172e84512 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.405587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.406177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.406462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.406734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.410431 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8dd9d-92cd-409c-96ce-9cdd67e55e7c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.411793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:16.421709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.422510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.423212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.423212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] PATH_INFO: `/v3/users/354a13ba745d4c129a920bc47f390f12` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.424988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=354a13ba745d4c129a920bc47f390f12)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.427037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.483311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.484798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.490308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354a13ba745d4c129a920bc47f390f12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:16.495780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 987/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:16.500966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354a13ba745d4c129a920bc47f390f12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:16.507599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.518564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354a13ba745d4c129a920bc47f390f12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:16.519434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354a13ba745d4c129a920bc47f390f12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:16.520077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b01ec94-646f-4b16-a1f3-17357d536d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354a13ba745d4c129a920bc47f390f12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:16.524448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39173c-17a7-4b94-913f-f1125ecb9c00 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.531399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.532121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.532487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.532816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.533609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.535454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.536989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 999/1986] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:16 2022] DELETE /identity/v3/users/354a13ba745d4c129a920bc47f390f12 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:16.543193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.546418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.546738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.559087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 988/1987] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:16.560278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.562723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:16.569931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:16.571158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:16.581014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed8674-78ba-4005-a58b-ddc5d6f1cb35 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.636169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1000/1988] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:16.645528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.647147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:16.667628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.668848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.669260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.669746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.670727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.674576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.683445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:16.697705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 989/1989] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:16.699251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:16.719796 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b89bbd-1834-41e8-9b38-0e9a665c7b2c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.734396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3846b-8dd3-425c-a7e3-6290cbcbdcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.734974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3846b-8dd3-425c-a7e3-6290cbcbdcbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.735364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3846b-8dd3-425c-a7e3-6290cbcbdcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.735875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3846b-8dd3-425c-a7e3-6290cbcbdcbc admin admin] PATH_INFO: `/v3/projects/cbc7683720274b38975811e45901d9aa/users/ef2451aad1ac4c12b424d141be741b63/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.743768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a858d0c-1a2b-4ee6-a0f7-8338a0cf9393 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:16.748541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:16.749395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.749791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.750090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.760909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3846b-8dd3-425c-a7e3-6290cbcbdcbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc7683720274b38975811e45901d9aa, user_id=ef2451aad1ac4c12b424d141be741b63, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.764976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3846b-8dd3-425c-a7e3-6290cbcbdcbc admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.767239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:16.769187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:16.780709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 990/1990] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:16 2022] PUT /identity/v3/projects/cbc7683720274b38975811e45901d9aa/users/ef2451aad1ac4c12b424d141be741b63/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:16.814393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5c85-4954-457d-8846-f247be02363d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:16.817333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5c85-4954-457d-8846-f247be02363d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:16.817927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5c85-4954-457d-8846-f247be02363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:16.835533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1001/1991] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:16.886064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d86a5c85-4954-457d-8846-f247be02363d None None] MFA Rules not processed for user `ef2451aad1ac4c12b424d141be741b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:16.887554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d86a5c85-4954-457d-8846-f247be02363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:16.973650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:17.041622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 991/1992] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:17.054316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:17.057135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:17.176465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72e97-bdd8-4622-8f04-343c91016b1d service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:17.351566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:17.352540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:17.352540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:17.352792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:17.363888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:17.366192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:17.386568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1002/1993] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:17.413110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5c85-4954-457d-8846-f247be02363d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:17.441115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:17.443021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:17.594755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5c85-4954-457d-8846-f247be02363d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:17.601278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:17.602630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:17.603583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:17.603934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] PATH_INFO: `/v3/users/ef2451aad1ac4c12b424d141be741b63` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:17.605173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2451aad1ac4c12b424d141be741b63)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:17.607488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:17.607622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216133ad-7bd5-4101-bd6f-304ef09cbf35 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:17.612808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:17.613458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:17.613737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:17.613997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] PATH_INFO: `/v3/projects/80fdd74529694535a12ca0c275d3baed` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:17.615144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fdd74529694535a12ca0c275d3baed)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:17.617107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:17.649436 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:17.705664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fdd74529694535a12ca0c275d3baed', 'request_id': 'req-06ef0438-9b9a-4905-a901-8110dd371591'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.716230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fdd74529694535a12ca0c275d3baed', 'request_id': 'req-06ef0438-9b9a-4905-a901-8110dd371591'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.726337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fdd74529694535a12ca0c275d3baed', 'request_id': 'req-06ef0438-9b9a-4905-a901-8110dd371591'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.753471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2451aad1ac4c12b424d141be741b63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.756410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] The token cache is being invalidate because project 80fdd74529694535a12ca0c275d3baed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:17.756719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.758131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.762606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1003/1994] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:17 2022] DELETE /identity/v3/projects/80fdd74529694535a12ca0c275d3baed => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:17.762761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2451aad1ac4c12b424d141be741b63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.767984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:17.769560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:17.790460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2451aad1ac4c12b424d141be741b63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.791275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2451aad1ac4c12b424d141be741b63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.791932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1afae729-6b0b-40a0-aede-4adbc865f287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2451aad1ac4c12b424d141be741b63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:17.811077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 992/1995] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:17 2022] DELETE /identity/v3/users/ef2451aad1ac4c12b424d141be741b63 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:17.815270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:17.815499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:17.815800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:17.843114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:17.844588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:17.856225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0438-9b9a-4905-a901-8110dd371591 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:17.915505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:17.935061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 993/1996] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:17.947097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:17.948794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:17.964194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:17.964879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:17.965611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:17.965611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] PATH_INFO: `/v3/users/a503fd34d6dd47d1884689561abf2ee8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:17.966868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a503fd34d6dd47d1884689561abf2ee8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:17.969661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:18.038017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a503fd34d6dd47d1884689561abf2ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.046452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a503fd34d6dd47d1884689561abf2ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.053246 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:18.069171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a503fd34d6dd47d1884689561abf2ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.070518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a503fd34d6dd47d1884689561abf2ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.071388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a503fd34d6dd47d1884689561abf2ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.090862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1004/1997] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:17 2022] DELETE /identity/v3/users/a503fd34d6dd47d1884689561abf2ee8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:18.160928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d429-540e-4acf-a77f-d0db7540f7bd None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:18.289780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22ffb2-999f-4fc8-ba7d-827017b3ed54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:18.292902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ffb2-999f-4fc8-ba7d-827017b3ed54 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:18.293624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ffb2-999f-4fc8-ba7d-827017b3ed54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:18.294289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ffb2-999f-4fc8-ba7d-827017b3ed54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:18.297165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fa22ffb2-999f-4fc8-ba7d-827017b3ed54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:18.416709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22ffb2-999f-4fc8-ba7d-827017b3ed54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:18.419356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22ffb2-999f-4fc8-ba7d-827017b3ed54 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:18.434264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 994/1998] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:18.689449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:18.691160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:18.711602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf1b2-dcf1-4dd3-89f5-9ec5a00a45cc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:18.717662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:18.718307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:18.718584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:18.718855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] PATH_INFO: `/v3/projects/0f77f16dff1a43c48ddce700e9b7284a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:18.720133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f77f16dff1a43c48ddce700e9b7284a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:18.722322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:18.822040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f77f16dff1a43c48ddce700e9b7284a', 'request_id': 'req-e7e28d46-076b-4a8f-93ef-8b717aac01cd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.838368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f77f16dff1a43c48ddce700e9b7284a', 'request_id': 'req-e7e28d46-076b-4a8f-93ef-8b717aac01cd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.861825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f77f16dff1a43c48ddce700e9b7284a', 'request_id': 'req-e7e28d46-076b-4a8f-93ef-8b717aac01cd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.878177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] The token cache is being invalidate because project 0f77f16dff1a43c48ddce700e9b7284a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:18.878468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.879440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:18.881258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1005/1999] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:18 2022] DELETE /identity/v3/projects/0f77f16dff1a43c48ddce700e9b7284a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:18.887275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1712-3ead-4da4-b7b2-8a1548b711a8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:18.888233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1712-3ead-4da4-b7b2-8a1548b711a8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:18.888659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1712-3ead-4da4-b7b2-8a1548b711a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:18.907257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:18.911991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:18.916336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2b6c1712-3ead-4da4-b7b2-8a1548b711a8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:18.917930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2b6c1712-3ead-4da4-b7b2-8a1548b711a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.053819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e28d46-076b-4a8f-93ef-8b717aac01cd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.060816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.061744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.062384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.062504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] PATH_INFO: `/v3/projects/cbc7683720274b38975811e45901d9aa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.064501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc7683720274b38975811e45901d9aa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.066958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.081904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 995/2000] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:19.083392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.083706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.083964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.115215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:19.125731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:19.127247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.143414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 996/2001] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:19.143414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.145043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.157601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e729dc-0830-4f44-a811-145675e73690 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.161801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc7683720274b38975811e45901d9aa', 'request_id': 'req-43ceaedd-f530-4944-a2bd-a34850a0447a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.171247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc7683720274b38975811e45901d9aa', 'request_id': 'req-43ceaedd-f530-4944-a2bd-a34850a0447a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.176724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:19.178120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc7683720274b38975811e45901d9aa', 'request_id': 'req-43ceaedd-f530-4944-a2bd-a34850a0447a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.193172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] The token cache is being invalidate because project cbc7683720274b38975811e45901d9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:19.193461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.195140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.197232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1006/2002] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:18 2022] DELETE /identity/v3/projects/cbc7683720274b38975811e45901d9aa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:19.201405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.202753 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.232616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.233379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.233657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.233931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] PATH_INFO: `/v3/users/1b31fe358f0e4cad8efc9ce7483fc1e9` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.235400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b31fe358f0e4cad8efc9ce7483fc1e9)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.237626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.270873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceaedd-f530-4944-a2bd-a34850a0447a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.276390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767bad0-3f55-4af2-b6a1-f2cecf620b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.277002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767bad0-3f55-4af2-b6a1-f2cecf620b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.277831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767bad0-3f55-4af2-b6a1-f2cecf620b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.277831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767bad0-3f55-4af2-b6a1-f2cecf620b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.278371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767bad0-3f55-4af2-b6a1-f2cecf620b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:19.278619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767bad0-3f55-4af2-b6a1-f2cecf620b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.280274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767bad0-3f55-4af2-b6a1-f2cecf620b24 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.292603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1007/2003] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:19.296696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b31fe358f0e4cad8efc9ce7483fc1e9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.297322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.297609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.298034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.305371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b31fe358f0e4cad8efc9ce7483fc1e9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.319575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:19.320804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.321755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b31fe358f0e4cad8efc9ce7483fc1e9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.322478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b31fe358f0e4cad8efc9ce7483fc1e9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.323094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-08ccfd5e-e76d-487f-8548-326aa6606140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b31fe358f0e4cad8efc9ce7483fc1e9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:19.329156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1008/2004] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:19.336477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.337697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 997/2005] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:19 2022] DELETE /identity/v3/users/1b31fe358f0e4cad8efc9ce7483fc1e9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:19.338460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.340785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eae0d2-207e-490c-b81a-4a72e2e6e353 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.341276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eae0d2-207e-490c-b81a-4a72e2e6e353 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.341713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eae0d2-207e-490c-b81a-4a72e2e6e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.351906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f295cd-5af4-4d6d-ab00-9e89d430fdd8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.363863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-38eae0d2-207e-490c-b81a-4a72e2e6e353 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:19.365114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-38eae0d2-207e-490c-b81a-4a72e2e6e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.414121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.414745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.415054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.415341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.416150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.418058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.432922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 998/2006] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:19.436738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63a8e0-2cfa-42e0-9710-805a4095afbf None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.437193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63a8e0-2cfa-42e0-9710-805a4095afbf None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.437446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63a8e0-2cfa-42e0-9710-805a4095afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.451510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1009/2007] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:19.451510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.457029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5f63a8e0-2cfa-42e0-9710-805a4095afbf None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:19.458272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5f63a8e0-2cfa-42e0-9710-805a4095afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.472350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:19.543818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 999/2008] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:19.544674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63a8e0-2cfa-42e0-9710-805a4095afbf None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.568248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e63d6-db31-4d5b-89f2-47332c67c2c2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.577828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63a8e0-2cfa-42e0-9710-805a4095afbf None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.580285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.581677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.582068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.582348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.583003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:19.583309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.584949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.591432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.592194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.592564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.593039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.593838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.594387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:19.607257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1010/2009] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:19.608318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.608798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.612861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:19.651948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1000/2010] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:19.653290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.669125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86906d4-0382-4073-950f-14eb6070ea03 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.676123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.676823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.677109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.677381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.678025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.680006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.711758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1001/2011] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:19.715839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.717944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db4ef1-8886-4f0e-a52d-bf039d4347fc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.784003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.785956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.786736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.787208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.789209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61ffb-5bb2-40c0-878a-8cc93a5354d8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.794384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.795140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.795906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.796160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.796967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.799242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.802276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.804158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.812827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1002/2012] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:19.813874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.825520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1011/2013] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:19.825664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019561b-b008-4035-b84f-8da0dd82949e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.828532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.831164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.831985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.832433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.832868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.833843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.836881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.844128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf17c0-434a-4bdf-8b83-50e48676692d service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.851264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.852676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.854019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.854466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.855486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.858202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.865013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1003/2014] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:19.869392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.874901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1012/2015] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:19.879768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.881050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca853edb-bf1f-48f4-b423-e6e1f53d6ebc admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.887306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.888947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.889411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.889909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.890760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.893407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.906978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1004/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:19.912049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.925851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e3773-61b2-4d10-a2ab-bb0e47f246f4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.927713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7b9c2-ecc8-468c-a666-1afc8686a2b7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.934382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.934972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d60c67-ae8b-44f5-acf9-7a471a8751f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:19.935673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.936179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.936669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60c67-ae8b-44f5-acf9-7a471a8751f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:19.936921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.937035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60c67-ae8b-44f5-acf9-7a471a8751f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:19.937200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60c67-ae8b-44f5-acf9-7a471a8751f3 admin admin] PATH_INFO: `/v3/projects/9a03b523ae2c43da82cf9d0c398c0d72/users/92e9a24eaa4645a6839afecdb25ea6aa/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:19.938338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.940565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.954653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1005/2017] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:19.957713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d60c67-ae8b-44f5-acf9-7a471a8751f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a03b523ae2c43da82cf9d0c398c0d72, user_id=92e9a24eaa4645a6839afecdb25ea6aa, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:19.958980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:19.961253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d60c67-ae8b-44f5-acf9-7a471a8751f3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:19.979650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1013/2018] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:19 2022] PUT /identity/v3/projects/9a03b523ae2c43da82cf9d0c398c0d72/users/92e9a24eaa4645a6839afecdb25ea6aa/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:19.986886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e933ee2-34da-4f00-a39e-24a1eac5ca4d admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:19.992595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b51f10-b8a1-47e2-a5b8-4d2b7af72804 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.005205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b51f10-b8a1-47e2-a5b8-4d2b7af72804 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.005517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b51f10-b8a1-47e2-a5b8-4d2b7af72804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.038551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:20.044251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b3b51f10-b8a1-47e2-a5b8-4d2b7af72804 None None] MFA Rules not processed for user `92e9a24eaa4645a6839afecdb25ea6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:20.045583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b3b51f10-b8a1-47e2-a5b8-4d2b7af72804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:20.071912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73007739-1b2a-4e66-a864-cb0771b70a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.073276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007739-1b2a-4e66-a864-cb0771b70a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.074163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007739-1b2a-4e66-a864-cb0771b70a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.074530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007739-1b2a-4e66-a864-cb0771b70a23 admin admin] PATH_INFO: `/v3/projects/b897c811e0e24357b3e467f46a443463/users/36d2cb4a9fd44d6a9646a3539139ff38/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.094396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73007739-1b2a-4e66-a864-cb0771b70a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b897c811e0e24357b3e467f46a443463, user_id=36d2cb4a9fd44d6a9646a3539139ff38, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.098031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73007739-1b2a-4e66-a864-cb0771b70a23 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.127480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1006/2019] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:19 2022] PUT /identity/v3/projects/b897c811e0e24357b3e467f46a443463/users/36d2cb4a9fd44d6a9646a3539139ff38/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:20.128516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1014/2020] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:20.131390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.131799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.132185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.134765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b51f10-b8a1-47e2-a5b8-4d2b7af72804 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.183398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b51f10-b8a1-47e2-a5b8-4d2b7af72804 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.199631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:20.229265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] MFA Rules not processed for user `36d2cb4a9fd44d6a9646a3539139ff38`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:20.230753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:20.302143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.304228 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.306544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.307019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.307927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.313187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.338655 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1007/2021] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:20.351636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.354489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:20.359094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1015/2022] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:20 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:20.360801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.462657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707946b-f043-4247-91ac-e8e3cd7513b3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.467622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.468416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.468839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.469171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.469993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.472107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.486933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059923e-be32-4614-9cbf-b404c260f36d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.499523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1016/2023] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:20 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:20.503426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.517382 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1f968-62bf-402b-b195-9f6e221589c3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.522878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.523867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.524049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.524473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.525708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.527677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.541305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1017/2024] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:20.541305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.542495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:20.555958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c41d5-f7a3-4f13-ba0f-529a18884855 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.561769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.562504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.562787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.563055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] PATH_INFO: `/v3/projects/46eb684f7fb948f6ad0dcd228ac599ff` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.564577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=46eb684f7fb948f6ad0dcd228ac599ff)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.566978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.567286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:20.583249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.584495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.584840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.585187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.651215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46eb684f7fb948f6ad0dcd228ac599ff', 'request_id': 'req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:20.656973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.658863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.663423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46eb684f7fb948f6ad0dcd228ac599ff', 'request_id': 'req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:20.670635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1008/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:20.671652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.673673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46eb684f7fb948f6ad0dcd228ac599ff', 'request_id': 'req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:20.682588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaa3a5-15e9-4d41-9d3d-0ca4764d3010 service glance] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.685863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:20.696988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] The token cache is being invalidate because project 46eb684f7fb948f6ad0dcd228ac599ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:20.698081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:20.699107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:20.701433 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1018/2026] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:20 2022] DELETE /identity/v3/projects/46eb684f7fb948f6ad0dcd228ac599ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:20.706279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.711968 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:20.792070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.792808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.793177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.794210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.811312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.813467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.843495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1009/2027] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:20.845286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:20.847841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14d963-6e2c-4f06-a4b5-3dd50fd8e5dc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.849640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:20.853247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.853938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.854215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.855414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] PATH_INFO: `/v3/users/528d869011f44b21884df70bdda62b67` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.855669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528d869011f44b21884df70bdda62b67)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.857581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.881560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5e7b0-c15f-4412-a20f-70708520d385 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:20.887261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d1e4-dfd4-49c8-83a3-e6941adb2216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:20.887593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d1e4-dfd4-49c8-83a3-e6941adb2216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.887959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d1e4-dfd4-49c8-83a3-e6941adb2216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.888331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d1e4-dfd4-49c8-83a3-e6941adb2216 admin admin] PATH_INFO: `/v3/projects/a7bf0ef747f8440797a7e7b4caddfe50/users/a5878d0091004a94a616c79f797cd59e/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:20.928714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169d1e4-dfd4-49c8-83a3-e6941adb2216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bf0ef747f8440797a7e7b4caddfe50, user_id=a5878d0091004a94a616c79f797cd59e, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:20.935715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169d1e4-dfd4-49c8-83a3-e6941adb2216 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:20.971007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1010/2028] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:20 2022] PUT /identity/v3/projects/a7bf0ef747f8440797a7e7b4caddfe50/users/a5878d0091004a94a616c79f797cd59e/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:20.982014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528d869011f44b21884df70bdda62b67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:20.989148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753200-1967-4557-bccd-e23ee3dd61ff None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:20.989511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753200-1967-4557-bccd-e23ee3dd61ff None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:20.989861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753200-1967-4557-bccd-e23ee3dd61ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:21.011630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528d869011f44b21884df70bdda62b67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:21.060601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528d869011f44b21884df70bdda62b67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:21.061426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528d869011f44b21884df70bdda62b67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:21.062219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528d869011f44b21884df70bdda62b67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:21.072479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e6753200-1967-4557-bccd-e23ee3dd61ff None None] MFA Rules not processed for user `a5878d0091004a94a616c79f797cd59e`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:21.075159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e6753200-1967-4557-bccd-e23ee3dd61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:21.095964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1019/2029] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:20 2022] DELETE /identity/v3/users/528d869011f44b21884df70bdda62b67 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:21.241129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1011/2030] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:21.246588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:21.261170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:21.420178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dd12-c843-4f7a-ad02-cd71969fbad6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:21.425273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:21.427303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:21.427303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:21.427303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:21.427303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:21.429285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:21.489862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1020/2031] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:21 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:21.495289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6753200-1967-4557-bccd-e23ee3dd61ff None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:21.501515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:21.663649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6753200-1967-4557-bccd-e23ee3dd61ff None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:21.792882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:21.795313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:21.804886 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:21.810944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:21.811793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:21.812032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:21.812300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:21.813150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:21.814977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:21.842882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1012/2032] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:21 2022] POST /identity/v3/users => generated 296 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:21.844462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:21.858096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e67cd-2bb3-4264-b19a-f3959599ab23 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:21.867320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:21.869869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:21.870960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:21.871243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:21.872160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:21.873802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:21.896239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1013/2033] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:21.901451 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:21.908811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347bdaa-57b1-4ade-9da4-1dee40583ff8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:21.912542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24666d5-59f6-4566-b745-43ef86d06f49 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:21.915799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:21.916812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:21.916812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:21.917154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] PATH_INFO: `/v3/projects/11584bb5fb784c2eb386e00a9ce68a27` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:21.918141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=11584bb5fb784c2eb386e00a9ce68a27)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:21.918616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:21.919277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:21.919589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:21.919862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] PATH_INFO: `/v3/projects/73fbc712c02d4587a2455d82e4600a08/users/e0ca7b3e5f7b43839990c269f5b50dfa/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:21.920337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:21.944725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fbc712c02d4587a2455d82e4600a08, user_id=e0ca7b3e5f7b43839990c269f5b50dfa, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:21.948929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:21.971935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1014/2034] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:21 2022] PUT /identity/v3/projects/73fbc712c02d4587a2455d82e4600a08/users/e0ca7b3e5f7b43839990c269f5b50dfa/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:21.975489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:21.994923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11584bb5fb784c2eb386e00a9ce68a27', 'request_id': 'req-a042a747-1eae-4f13-a114-09ef44539beb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.010698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11584bb5fb784c2eb386e00a9ce68a27', 'request_id': 'req-a042a747-1eae-4f13-a114-09ef44539beb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.017891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11584bb5fb784c2eb386e00a9ce68a27', 'request_id': 'req-a042a747-1eae-4f13-a114-09ef44539beb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.042060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] The token cache is being invalidate because project 11584bb5fb784c2eb386e00a9ce68a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:22.042486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.043241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.045876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1021/2035] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:21 2022] DELETE /identity/v3/projects/11584bb5fb784c2eb386e00a9ce68a27 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:22.047074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.050179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.069735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46edb57-657c-45fa-9367-972e5fe8fd19 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.079747 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:22.127663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a747-1eae-4f13-a114-09ef44539beb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.132614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.133322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.133656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.134524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] PATH_INFO: `/v3/users/e1d17cc936e54964bb382f07a96e2acf` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.135893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d17cc936e54964bb382f07a96e2acf)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.137930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.143558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a281d-3af4-46ac-bb96-db6810c60500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.144483 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a281d-3af4-46ac-bb96-db6810c60500 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.144829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a281d-3af4-46ac-bb96-db6810c60500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.145160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a281d-3af4-46ac-bb96-db6810c60500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.145882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a281d-3af4-46ac-bb96-db6810c60500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.147579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a281d-3af4-46ac-bb96-db6810c60500 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.161620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1015/2036] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:22.163320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.163687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.164125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.194506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:22.194752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:22.196019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.204906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1016/2037] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:22.211592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d17cc936e54964bb382f07a96e2acf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.211731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.211731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.215726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d17cc936e54964bb382f07a96e2acf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.222107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83afd5f-2261-4796-971d-a12016cde3eb None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.226998 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20877f4a-2ac5-4932-8e5d-b6c0321c4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.228268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20877f4a-2ac5-4932-8e5d-b6c0321c4e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.228553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20877f4a-2ac5-4932-8e5d-b6c0321c4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.228828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20877f4a-2ac5-4932-8e5d-b6c0321c4e43 admin admin] PATH_INFO: `/v3/projects/73fbc712c02d4587a2455d82e4600a08/users/e0ca7b3e5f7b43839990c269f5b50dfa/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.230157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d17cc936e54964bb382f07a96e2acf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.230745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20877f4a-2ac5-4932-8e5d-b6c0321c4e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fbc712c02d4587a2455d82e4600a08, user_id=e0ca7b3e5f7b43839990c269f5b50dfa, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.230986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d17cc936e54964bb382f07a96e2acf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.231705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5362406f-fb78-4f5b-a821-4c5db219f049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d17cc936e54964bb382f07a96e2acf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:22.233452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20877f4a-2ac5-4932-8e5d-b6c0321c4e43 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.251866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1022/2038] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:22 2022] DELETE /identity/v3/users/e1d17cc936e54964bb382f07a96e2acf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:22.253702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8be41-2728-45de-b139-ca7f9dcdca0a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.253702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8be41-2728-45de-b139-ca7f9dcdca0a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.254136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8be41-2728-45de-b139-ca7f9dcdca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.255514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1017/2039] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:22 2022] PUT /identity/v3/projects/73fbc712c02d4587a2455d82e4600a08/users/e0ca7b3e5f7b43839990c269f5b50dfa/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:22.269050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69aa3-8a18-4021-81a6-513477e87693 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.269326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69aa3-8a18-4021-81a6-513477e87693 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.269621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69aa3-8a18-4021-81a6-513477e87693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.279875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-40c8be41-2728-45de-b139-ca7f9dcdca0a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:22.281118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-40c8be41-2728-45de-b139-ca7f9dcdca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.293010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-11a69aa3-8a18-4021-81a6-513477e87693 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:22.294205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-11a69aa3-8a18-4021-81a6-513477e87693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.351293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1023/2040] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:22.351293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d0a65-fdb3-4be7-92e4-7580f48f3309 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.351293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d0a65-fdb3-4be7-92e4-7580f48f3309 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.351293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d0a65-fdb3-4be7-92e4-7580f48f3309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.359480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1018/2041] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:22.360330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a69aa3-8a18-4021-81a6-513477e87693 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.370840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a69aa3-8a18-4021-81a6-513477e87693 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.376190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.377060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.377389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.377657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.378375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:22.378624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.380341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.389987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1f2d0a65-fdb3-4be7-92e4-7580f48f3309 None None] MFA Rules not processed for user `e0ca7b3e5f7b43839990c269f5b50dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:22.391667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1f2d0a65-fdb3-4be7-92e4-7580f48f3309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.396288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1019/2042] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:22.397362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.399065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.463007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d328f-2f9d-4c8c-88f2-09a98c5a9a03 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.467195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.467826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.468221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1024/2043] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:22.468340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.468340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.469007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d0a65-fdb3-4be7-92e4-7580f48f3309 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.478850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.479856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d0a65-fdb3-4be7-92e4-7580f48f3309 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.480565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.484518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.485113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.485391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.485661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.486321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.488318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.490225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1020/2044] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:22.491057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.492646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.513897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:22.524503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1025/2045] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:22 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:22.528948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.564585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e44294-89a9-4a86-8a72-599c46d328cf service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.575872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:22.633863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.634521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.634830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.635092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.650183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acdd63-ae76-4276-ad1a-ef1cfc4899f9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.656153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.656757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.657029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.657296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.660159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.662212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.702337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1026/2046] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:22 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:22.703050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.716363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a215a-f487-4677-b595-24f2df1b212a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.721979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.722329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.722606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.722876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.723720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.728961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.745097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1027/2047] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:22.748840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.749283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.750510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.763912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f71ac-c05f-4b90-bdc6-7ffc9abc2291 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.771726 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.772360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.772696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.772972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.773629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.775618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.778269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1021/2048] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:22.806144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1028/2049] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:22.810216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.823892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb57542-8a55-4d57-a446-c8ee22001262 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.829719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.831510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.832073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.832876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.833226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.833692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] PATH_INFO: `/v3/projects/b3c3d0dce9184e5aa4dbecdb4f609e49/users/7b4f7f5b30c94199aab171c036e46401/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.852288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da9b97-9fa6-48e0-aa1c-0d0588bd078c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.857498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407b597-303c-4981-a8ab-db0abf1ec415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:22.858851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407b597-303c-4981-a8ab-db0abf1ec415 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.859517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407b597-303c-4981-a8ab-db0abf1ec415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.859517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407b597-303c-4981-a8ab-db0abf1ec415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.861733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7407b597-303c-4981-a8ab-db0abf1ec415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.866688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c3d0dce9184e5aa4dbecdb4f609e49, user_id=7b4f7f5b30c94199aab171c036e46401, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.870282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.889381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1022/2050] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:22 2022] PUT /identity/v3/projects/b3c3d0dce9184e5aa4dbecdb4f609e49/users/7b4f7f5b30c94199aab171c036e46401/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:22.890379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:22.900069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:22.949666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407b597-303c-4981-a8ab-db0abf1ec415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:22.951106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407b597-303c-4981-a8ab-db0abf1ec415 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:22.959998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1029/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:22.961244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975131-926d-492d-8a54-bfb2b3255a44 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:22.961527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975131-926d-492d-8a54-bfb2b3255a44 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:22.961832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975131-926d-492d-8a54-bfb2b3255a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:22.978811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae524f20-1f5c-4754-9b92-db5c8ef4a99d admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:22.993662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-dd975131-926d-492d-8a54-bfb2b3255a44 None None] MFA Rules not processed for user `7b4f7f5b30c94199aab171c036e46401`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:22.995080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dd975131-926d-492d-8a54-bfb2b3255a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:23.004943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:23.005603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:23.005883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:23.006183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] PATH_INFO: `/v3/projects/26317b958de44018a59715732ee2b322` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:23.007603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26317b958de44018a59715732ee2b322)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:23.011315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:23.013387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:23.077727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26317b958de44018a59715732ee2b322', 'request_id': 'req-af64bc88-6503-479e-991c-15c6c5600e28'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.094764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1030/2052] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:23.095079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26317b958de44018a59715732ee2b322', 'request_id': 'req-af64bc88-6503-479e-991c-15c6c5600e28'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.100641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26317b958de44018a59715732ee2b322', 'request_id': 'req-af64bc88-6503-479e-991c-15c6c5600e28'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.102697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975131-926d-492d-8a54-bfb2b3255a44 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:23.121569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] The token cache is being invalidate because project 26317b958de44018a59715732ee2b322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:23.122136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.123494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.125843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1023/2053] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:22 2022] DELETE /identity/v3/projects/26317b958de44018a59715732ee2b322 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:23.126744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:23.130533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:23.140875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:23.217771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975131-926d-492d-8a54-bfb2b3255a44 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:23.234967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64bc88-6503-479e-991c-15c6c5600e28 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:23.240160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:23.240955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:23.241295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:23.241852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] PATH_INFO: `/v3/users/62467fe2a9624168be06eb27dc16ec33` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:23.244383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62467fe2a9624168be06eb27dc16ec33)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:23.246719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:23.288359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f7f75-9452-4027-b186-1b624997c95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:23.289127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f7f75-9452-4027-b186-1b624997c95f service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:23.289554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f7f75-9452-4027-b186-1b624997c95f service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:23.290011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f7f75-9452-4027-b186-1b624997c95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:23.292277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-db9f7f75-9452-4027-b186-1b624997c95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:23.318260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62467fe2a9624168be06eb27dc16ec33'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.327193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62467fe2a9624168be06eb27dc16ec33'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.353492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62467fe2a9624168be06eb27dc16ec33'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.354883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62467fe2a9624168be06eb27dc16ec33'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.356156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62467fe2a9624168be06eb27dc16ec33'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.376934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1024/2054] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:23 2022] DELETE /identity/v3/users/62467fe2a9624168be06eb27dc16ec33 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:23.384034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f7f75-9452-4027-b186-1b624997c95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:23.387616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f7f75-9452-4027-b186-1b624997c95f service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:23.402223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1031/2055] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:23.700337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:23.701916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:23.731318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:23.804157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4aba-5703-4585-abb3-c6d0f544b895 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:23.809324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:23.809947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:23.810229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:23.810499 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] PATH_INFO: `/v3/projects/768c9341970047cfa4fc6a5d37b3bddd` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:23.811687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=768c9341970047cfa4fc6a5d37b3bddd)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:23.813611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:23.860691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768c9341970047cfa4fc6a5d37b3bddd', 'request_id': 'req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.867716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768c9341970047cfa4fc6a5d37b3bddd', 'request_id': 'req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.874034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768c9341970047cfa4fc6a5d37b3bddd', 'request_id': 'req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.886092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] The token cache is being invalidate because project 768c9341970047cfa4fc6a5d37b3bddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:23.886382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.887061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3f5e5939-bd41-41b6-8ced-9a02c2b9bf7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:23.888585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1025/2056] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:23 2022] DELETE /identity/v3/projects/768c9341970047cfa4fc6a5d37b3bddd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:23.894638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c165-5d95-4962-aa32-51c250eb5a36 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:23.894943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c165-5d95-4962-aa32-51c250eb5a36 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:23.895216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c165-5d95-4962-aa32-51c250eb5a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:23.917169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-69f3c165-5d95-4962-aa32-51c250eb5a36 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:23.918388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-69f3c165-5d95-4962-aa32-51c250eb5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:23.979865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1032/2057] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:23.988928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136023d-db0d-4e1c-96d3-31d32d4f2641 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:23.989212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136023d-db0d-4e1c-96d3-31d32d4f2641 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:23.990190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136023d-db0d-4e1c-96d3-31d32d4f2641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.012287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a136023d-db0d-4e1c-96d3-31d32d4f2641 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:24.013491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a136023d-db0d-4e1c-96d3-31d32d4f2641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:24.021614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1026/2058] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:24.026343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3c165-5d95-4962-aa32-51c250eb5a36 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.036000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3c165-5d95-4962-aa32-51c250eb5a36 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.041056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.041657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.041934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.042207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.042847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:24.043145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.044786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.056573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1033/2059] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:24.061072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136023d-db0d-4e1c-96d3-31d32d4f2641 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.070933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136023d-db0d-4e1c-96d3-31d32d4f2641 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.075672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.076273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.076554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.076826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.077458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.079394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.108241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1027/2060] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:24 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:24.112237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.122699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c750-9364-4944-92ec-3d0cb71c7f09 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.127347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:24.181168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.181772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.182051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.182351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.182989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.184991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.205891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1034/2061] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:24 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:24.209886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.220149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7200e-7dbe-41f9-a42c-8fa4cbd31f29 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.224714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.225294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.225570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.225834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.226489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.228705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.238464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1028/2062] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:24.242621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.253121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7795-923b-4ea1-8956-9451a0f59b10 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.257683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0af4e-e84b-4ce8-85c4-3ca8134fc89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.258267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0af4e-e84b-4ce8-85c4-3ca8134fc89d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.258563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0af4e-e84b-4ce8-85c4-3ca8134fc89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.258814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0af4e-e84b-4ce8-85c4-3ca8134fc89d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.259506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0af4e-e84b-4ce8-85c4-3ca8134fc89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.261115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0af4e-e84b-4ce8-85c4-3ca8134fc89d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.271455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1035/2063] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:24.275356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.285260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7c36-705b-48da-a5b5-8b4fac26ec70 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.289804 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.291073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.291347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.291642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] PATH_INFO: `/v3/projects/ba945022a0c84fa496fea4949ac0f207/users/b0060a22a6164987856ac6ec269b9a0a/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.307031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba945022a0c84fa496fea4949ac0f207, user_id=b0060a22a6164987856ac6ec269b9a0a, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.312156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.326676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1029/2064] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:24 2022] PUT /identity/v3/projects/ba945022a0c84fa496fea4949ac0f207/users/b0060a22a6164987856ac6ec269b9a0a/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:24.338998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf7ec-c71e-48f8-82a4-4c80694f4324 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.339584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf7ec-c71e-48f8-82a4-4c80694f4324 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.339584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf7ec-c71e-48f8-82a4-4c80694f4324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.369717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-606cf7ec-c71e-48f8-82a4-4c80694f4324 None None] MFA Rules not processed for user `b0060a22a6164987856ac6ec269b9a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:24.370949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-606cf7ec-c71e-48f8-82a4-4c80694f4324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:24.447046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1036/2065] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:24.449033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.519360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:24.547054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bde34-c670-429a-adb4-e9925cb2f9f6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.553121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.554515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.554898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.555275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.556635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.558842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.598591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1030/2066] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:24 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:24.603112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf7ec-c71e-48f8-82a4-4c80694f4324 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.618663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf7ec-c71e-48f8-82a4-4c80694f4324 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.700082 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.701168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.701519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.701862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.702609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.705025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.739412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1037/2067] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:24 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:24.741673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.754553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b4f2-f9ac-44e0-a99b-f80795659b10 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.772081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.772081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.772081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.772081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.772704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.774888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.794609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1031/2068] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:24.798881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.818237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5bb03-33eb-4b15-91a0-84da01c3311d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:24.829043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:24.830616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:24.831116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:24.831926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] PATH_INFO: `/v3/projects/ce2ff85c3e9e4d8c8461ec635a6c792f/users/22af2bc7bbeb46bc904ccfb4d2be6331/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:24.841918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:24.863926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2ff85c3e9e4d8c8461ec635a6c792f, user_id=22af2bc7bbeb46bc904ccfb4d2be6331, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:24.867263 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:24.889351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1038/2069] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:24 2022] PUT /identity/v3/projects/ce2ff85c3e9e4d8c8461ec635a6c792f/users/22af2bc7bbeb46bc904ccfb4d2be6331/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:24.893303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:24.904629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a1cf0-a13d-47df-9141-2072dc0dd220 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:25.011259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983b2e6-e69e-40a9-a353-a6b56fba1419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:25.011259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b2e6-e69e-40a9-a353-a6b56fba1419 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:25.011259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b2e6-e69e-40a9-a353-a6b56fba1419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:25.011259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b2e6-e69e-40a9-a353-a6b56fba1419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:25.011663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983b2e6-e69e-40a9-a353-a6b56fba1419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:25.015988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983b2e6-e69e-40a9-a353-a6b56fba1419 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:25.034833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1032/2070] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:25.038824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:25.051313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f04e7-df9e-47a5-ab46-05d249fe35cb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:25.061380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:25.062529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:25.062748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:25.063039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] PATH_INFO: `/v3/projects/ce2ff85c3e9e4d8c8461ec635a6c792f/users/22af2bc7bbeb46bc904ccfb4d2be6331/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:25.065891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2ff85c3e9e4d8c8461ec635a6c792f, user_id=22af2bc7bbeb46bc904ccfb4d2be6331, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:25.069267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:25.084897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1039/2071] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:25 2022] PUT /identity/v3/projects/ce2ff85c3e9e4d8c8461ec635a6c792f/users/22af2bc7bbeb46bc904ccfb4d2be6331/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:25.095761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:25.096169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:25.096651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:25.183588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] MFA Rules not processed for user `22af2bc7bbeb46bc904ccfb4d2be6331`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:25.184996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:25.339432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1033/2072] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:25.354676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:25.356656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:25.434602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a15aa8-50bc-43d7-9be1-dbfff47c6156 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:25.438220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284d62-3919-4bb6-8653-d6ee8036d487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:25.438821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284d62-3919-4bb6-8653-d6ee8036d487 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:25.439106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284d62-3919-4bb6-8653-d6ee8036d487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:25.439396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284d62-3919-4bb6-8653-d6ee8036d487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:25.503788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284d62-3919-4bb6-8653-d6ee8036d487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:25.505237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284d62-3919-4bb6-8653-d6ee8036d487 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:25.515294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1040/2073] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:26.092094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:26.093574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:26.129518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:26.162179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776cfde-a81b-404b-b511-ff32d2509564 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:26.167323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:26.168051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:26.168405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:26.168679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] PATH_INFO: `/v3/users/92e9a24eaa4645a6839afecdb25ea6aa` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:26.169814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e9a24eaa4645a6839afecdb25ea6aa)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:26.172006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:26.223357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e9a24eaa4645a6839afecdb25ea6aa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:26.230332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e9a24eaa4645a6839afecdb25ea6aa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:26.245068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e9a24eaa4645a6839afecdb25ea6aa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:26.245739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e9a24eaa4645a6839afecdb25ea6aa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:26.246394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e9a24eaa4645a6839afecdb25ea6aa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:26.258643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1034/2074] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:26 2022] DELETE /identity/v3/users/92e9a24eaa4645a6839afecdb25ea6aa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:26.263927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:26.264227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:26.264505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:26.287862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:26.289101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:26.353401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1041/2075] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:26.363659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:26.365220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:26.425349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43da29f-2c7c-4662-a910-8ba135f0a419 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:26.429538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:26.430194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:26.430517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:26.430788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:26.439983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:26.441433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:26.451884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1035/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:26.814623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:26.816863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:26.846148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd3f8e-b731-4681-ace5-d02aeeae8323 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:26.852031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:26.857552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:26.861452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:26.861979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:26.862322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:26.862526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] PATH_INFO: `/v3/users/7b4f7f5b30c94199aab171c036e46401` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:26.868656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4f7f5b30c94199aab171c036e46401)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:26.876006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:26.899785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e330231-f3e7-4407-bc8c-382b5356938c service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:26.906510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:26.907231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:26.907614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:26.908032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] PATH_INFO: `/v3/projects/9a03b523ae2c43da82cf9d0c398c0d72` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:26.910217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a03b523ae2c43da82cf9d0c398c0d72)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:26.913028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:26.929309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:27.002783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4f7f5b30c94199aab171c036e46401'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.012364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4f7f5b30c94199aab171c036e46401'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.027176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:27.031818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a03b523ae2c43da82cf9d0c398c0d72', 'request_id': 'req-594cc58a-70e2-4bb9-b98e-9bddfa71575e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.032793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4f7f5b30c94199aab171c036e46401'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.033698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4f7f5b30c94199aab171c036e46401'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.034620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-693dc626-1d09-49f0-80db-fee61d597d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4f7f5b30c94199aab171c036e46401'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.044401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a03b523ae2c43da82cf9d0c398c0d72', 'request_id': 'req-594cc58a-70e2-4bb9-b98e-9bddfa71575e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.051167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a03b523ae2c43da82cf9d0c398c0d72', 'request_id': 'req-594cc58a-70e2-4bb9-b98e-9bddfa71575e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.054319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1042/2077] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:26 2022] DELETE /identity/v3/users/7b4f7f5b30c94199aab171c036e46401 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:27.061434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:27.061724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:27.061996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:27.065678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] The token cache is being invalidate because project 9a03b523ae2c43da82cf9d0c398c0d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:27.066103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.067595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.069951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1036/2078] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:26 2022] DELETE /identity/v3/projects/9a03b523ae2c43da82cf9d0c398c0d72 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:27.074811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:27.078007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:27.088712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:27.090090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:27.158688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1043/2079] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:27.161032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc58a-70e2-4bb9-b98e-9bddfa71575e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:27.167439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:27.168033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:27.168315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:27.168954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] PATH_INFO: `/v3/users/a5878d0091004a94a616c79f797cd59e` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:27.170209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:27.170608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5878d0091004a94a616c79f797cd59e)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:27.175555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:27.175744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:27.223362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5878d0091004a94a616c79f797cd59e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.231220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5878d0091004a94a616c79f797cd59e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.240097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d36e-63b6-4e76-a3ea-a714bd0a5e80 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:27.244942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5878d0091004a94a616c79f797cd59e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.245207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:27.245720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5878d0091004a94a616c79f797cd59e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.245845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:27.246087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:27.246341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5878d0091004a94a616c79f797cd59e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.246575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:27.248386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:27.259566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1037/2080] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:27 2022] DELETE /identity/v3/users/a5878d0091004a94a616c79f797cd59e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:27.261620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:27.263142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:27.273861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1044/2081] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:27.711295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:27.712850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:27.717868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:27.718938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:27.731334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07553a09-8e7e-405a-a175-0f85309461ab service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:27.775330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:27.801016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:27.802209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:27.802643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:27.803065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] PATH_INFO: `/v3/projects/b3c3d0dce9184e5aa4dbecdb4f609e49` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:27.804818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c3d0dce9184e5aa4dbecdb4f609e49)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:27.807924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:27.851496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:27.863151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0a394-e357-4a27-934e-14785be03a0e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:27.871278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c3d0dce9184e5aa4dbecdb4f609e49', 'request_id': 'req-622c439b-e6cf-42f3-9a50-da441feeb66a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.892866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c3d0dce9184e5aa4dbecdb4f609e49', 'request_id': 'req-622c439b-e6cf-42f3-9a50-da441feeb66a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.900596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c3d0dce9184e5aa4dbecdb4f609e49', 'request_id': 'req-622c439b-e6cf-42f3-9a50-da441feeb66a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.919730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] The token cache is being invalidate because project b3c3d0dce9184e5aa4dbecdb4f609e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:27.920314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.921008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-622c439b-e6cf-42f3-9a50-da441feeb66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:27.922716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1045/2082] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:27 2022] DELETE /identity/v3/projects/b3c3d0dce9184e5aa4dbecdb4f609e49 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:27.928398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc8a2-f787-4b93-86d0-662392a23f4e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:27.928678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc8a2-f787-4b93-86d0-662392a23f4e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:27.928965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc8a2-f787-4b93-86d0-662392a23f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:27.952513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ef3bc8a2-f787-4b93-86d0-662392a23f4e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:27.956731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ef3bc8a2-f787-4b93-86d0-662392a23f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:27.982057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:27.982709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:27.983178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:27.983491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] PATH_INFO: `/v3/projects/a7bf0ef747f8440797a7e7b4caddfe50` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:27.985363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7bf0ef747f8440797a7e7b4caddfe50)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:27.988081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.065773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1046/2083] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:28.072015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5528-7ddb-4572-9880-eca376e9d6f7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.072353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5528-7ddb-4572-9880-eca376e9d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.072796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5528-7ddb-4572-9880-eca376e9d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.079080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bf0ef747f8440797a7e7b4caddfe50', 'request_id': 'req-0944f59a-16b9-490d-ba89-83195946d8c8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.088151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bf0ef747f8440797a7e7b4caddfe50', 'request_id': 'req-0944f59a-16b9-490d-ba89-83195946d8c8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.095755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bf0ef747f8440797a7e7b4caddfe50', 'request_id': 'req-0944f59a-16b9-490d-ba89-83195946d8c8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.099194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-32cf5528-7ddb-4572-9880-eca376e9d6f7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:28.100643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-32cf5528-7ddb-4572-9880-eca376e9d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.110987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] The token cache is being invalidate because project a7bf0ef747f8440797a7e7b4caddfe50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:28.111415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.112128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.117260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1038/2084] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:27 2022] DELETE /identity/v3/projects/a7bf0ef747f8440797a7e7b4caddfe50 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:28.118964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.121097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.218977 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1047/2085] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:28.222161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5528-7ddb-4572-9880-eca376e9d6f7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.238910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f59a-16b9-490d-ba89-83195946d8c8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.239839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5528-7ddb-4572-9880-eca376e9d6f7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.245936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.246696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.247047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.247460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] PATH_INFO: `/v3/users/e0ca7b3e5f7b43839990c269f5b50dfa` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.248772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.248926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ca7b3e5f7b43839990c269f5b50dfa)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.249888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.250356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.250927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.251213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.252581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:28.253089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.255745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.271668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:28.282210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1048/2086] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:28.283854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.287198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.313289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:28.313731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c444413-0ba1-432b-b776-7464988d8625 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.320053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.320928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.321116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.321438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] PATH_INFO: `/v3/users/b0060a22a6164987856ac6ec269b9a0a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.323313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0060a22a6164987856ac6ec269b9a0a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.325400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.327767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ca7b3e5f7b43839990c269f5b50dfa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.341222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ca7b3e5f7b43839990c269f5b50dfa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.362439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ca7b3e5f7b43839990c269f5b50dfa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.363519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ca7b3e5f7b43839990c269f5b50dfa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.364249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ca7b3e5f7b43839990c269f5b50dfa'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.381849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1039/2087] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:28 2022] DELETE /identity/v3/users/e0ca7b3e5f7b43839990c269f5b50dfa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:28.382555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.384094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.393842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0060a22a6164987856ac6ec269b9a0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.408817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0060a22a6164987856ac6ec269b9a0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.436583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0060a22a6164987856ac6ec269b9a0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.438817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0060a22a6164987856ac6ec269b9a0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.439719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3318626-749e-4324-9603-b4a9c93c936b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0060a22a6164987856ac6ec269b9a0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:28.459193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1049/2088] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:28 2022] DELETE /identity/v3/users/b0060a22a6164987856ac6ec269b9a0a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:28.465664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.465992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.467048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.495523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fcef9-207c-4c90-bc6a-cac5c840b791 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.506185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:28.509647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.571310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.572549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.573771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.574274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.579305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.581707 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.591158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1050/2089] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:28.601501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.603900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.616434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1040/2090] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:28 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:28.620897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.622569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.669748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119ba5e-c855-47be-b84f-bfb9b74bb26c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.677133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:28.706178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:28.713959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427b04b-72d2-4541-b773-fa4c22a5ac62 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.721343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.721960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.722242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.722518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.723158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.725912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.739540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.740169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.740548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.740863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.751254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1041/2091] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:28 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:28.754563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.755695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.756174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.768815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede4b5-4b88-4826-a39e-cae3c39a76f1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.769985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1051/2092] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:28.781332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.782047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.782402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.782769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.783882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.785295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.802578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1042/2093] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:28.804203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.815701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396599c1-66ad-4f48-9b85-ec3cb4cf312d service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.822146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.822847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.823191 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.823586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.824336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.826242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.842311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1052/2094] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:28.848937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.861995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3be81-0a5d-4e53-9387-00113449d522 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.867414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27989a-ec48-41a5-a569-9cab64062fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.868102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27989a-ec48-41a5-a569-9cab64062fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.868408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27989a-ec48-41a5-a569-9cab64062fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.868684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27989a-ec48-41a5-a569-9cab64062fce admin admin] PATH_INFO: `/v3/projects/d39443107f214449a0bcd083be081d04/users/10accf97ecb946788d347567746da534/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.876229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:28.877960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:28.895230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447b2ae-ced4-4a05-86a3-afc506ec9972 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:28.908595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:28.909900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.910328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.910774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] PATH_INFO: `/v3/projects/73fbc712c02d4587a2455d82e4600a08` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:28.912102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fbc712c02d4587a2455d82e4600a08)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.915700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.919695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27989a-ec48-41a5-a569-9cab64062fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39443107f214449a0bcd083be081d04, user_id=10accf97ecb946788d347567746da534, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:28.923127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27989a-ec48-41a5-a569-9cab64062fce admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:28.968733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1043/2095] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:28 2022] PUT /identity/v3/projects/d39443107f214449a0bcd083be081d04/users/10accf97ecb946788d347567746da534/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:28.971751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:28.972045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:28.972328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.013119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fbc712c02d4587a2455d82e4600a08', 'request_id': 'req-5f5a0f36-3405-4a69-af8e-a4823894b358'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.031502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fbc712c02d4587a2455d82e4600a08', 'request_id': 'req-5f5a0f36-3405-4a69-af8e-a4823894b358'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.045778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fbc712c02d4587a2455d82e4600a08', 'request_id': 'req-5f5a0f36-3405-4a69-af8e-a4823894b358'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.049689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] MFA Rules not processed for user `10accf97ecb946788d347567746da534`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:29.050560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.060605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] The token cache is being invalidate because project 73fbc712c02d4587a2455d82e4600a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:29.061018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.061794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5f5a0f36-3405-4a69-af8e-a4823894b358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.067419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1053/2096] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:28 2022] DELETE /identity/v3/projects/73fbc712c02d4587a2455d82e4600a08 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:29.070329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.070961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.071787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.127310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:29.128985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.217299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1044/2097] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:29.221700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.222915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.228052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1054/2098] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:29.231194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.233047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.240838 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b8a90-a4ac-44a5-8bde-7bcf283686be None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.246119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437fa9-bfba-4ef2-9cda-819229b8dcc4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.247041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.247702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.247977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.248242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] PATH_INFO: `/v3/projects/ba945022a0c84fa496fea4949ac0f207` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.249335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba945022a0c84fa496fea4949ac0f207)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.250794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e4353-93c2-4059-b844-639d7ee5ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.251230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.251460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4353-93c2-4059-b844-639d7ee5ef80 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.251692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4353-93c2-4059-b844-639d7ee5ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.251955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4353-93c2-4059-b844-639d7ee5ef80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.252579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e4353-93c2-4059-b844-639d7ee5ef80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.254463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e4353-93c2-4059-b844-639d7ee5ef80 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.287452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1055/2099] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:29 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:29.288310 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.288638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.288914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.309041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:29.310026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba945022a0c84fa496fea4949ac0f207', 'request_id': 'req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.310262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.318326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba945022a0c84fa496fea4949ac0f207', 'request_id': 'req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.326311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba945022a0c84fa496fea4949ac0f207', 'request_id': 'req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.327011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:29.337799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] The token cache is being invalidate because project ba945022a0c84fa496fea4949ac0f207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:29.338097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.338783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.340352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1045/2100] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:29 2022] DELETE /identity/v3/projects/ba945022a0c84fa496fea4949ac0f207 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:29.341192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.343323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.362040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:29.393594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1056/2101] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:29.394274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.395737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.408675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd98af-5714-417c-bf95-f713519248ee None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.413823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.414444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.415626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.415926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] PATH_INFO: `/v3/users/22af2bc7bbeb46bc904ccfb4d2be6331` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.417106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=22af2bc7bbeb46bc904ccfb4d2be6331)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.419012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.428670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208633-f4f2-473a-ad7c-5bb8f8c2acc4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.438508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.439470 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.439812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.440144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.440846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.448816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.470874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1046/2102] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:29 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:29.470874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.485725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21399c0b-acdf-46da-ac5c-5ee815a2f852 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.488025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22af2bc7bbeb46bc904ccfb4d2be6331'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.489120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.489731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.490010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.490288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.490937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:29.491240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.495415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.498213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22af2bc7bbeb46bc904ccfb4d2be6331'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.511437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1047/2103] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:29.511437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.519444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22af2bc7bbeb46bc904ccfb4d2be6331'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.520165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22af2bc7bbeb46bc904ccfb4d2be6331'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.520900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22af2bc7bbeb46bc904ccfb4d2be6331'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:29.527847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d23daf-0164-4ae0-b068-9d10600b01a3 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.533120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.533722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.534094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.534370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.535014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.536767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1057/2104] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:29 2022] DELETE /identity/v3/users/22af2bc7bbeb46bc904ccfb4d2be6331 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:29.536979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.537681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.539361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.552435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1048/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:29.557408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.559691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.578120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fb37-a5af-4352-975a-b7c05a97aaa8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.649157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497ba0-19f6-4485-9d6b-0136b422bfcf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.657491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.658115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.658398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.658668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.659323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.661270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.674517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.675600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.676118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.676450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.677231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.679441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.696970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1049/2106] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:29.698062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.710628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824014-8b36-4fa4-8f5f-4d55db9ea04d admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.716653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4bb50-24ab-4f6c-8bce-b2b7d99aa1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.718050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1058/2107] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:29 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:29.719818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4bb50-24ab-4f6c-8bce-b2b7d99aa1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.721119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4bb50-24ab-4f6c-8bce-b2b7d99aa1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.721589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4bb50-24ab-4f6c-8bce-b2b7d99aa1c7 admin admin] PATH_INFO: `/v3/projects/1ecd632edfc441da8dd8600efed94713/users/4159fa3b465c4d03b847f3456fe6af51/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.723255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.748769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4bb50-24ab-4f6c-8bce-b2b7d99aa1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecd632edfc441da8dd8600efed94713, user_id=4159fa3b465c4d03b847f3456fe6af51, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.754395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4bb50-24ab-4f6c-8bce-b2b7d99aa1c7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.769754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:29.777104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1050/2108] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:29 2022] PUT /identity/v3/projects/1ecd632edfc441da8dd8600efed94713/users/4159fa3b465c4d03b847f3456fe6af51/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:29.787341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.787653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.787930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.837583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] MFA Rules not processed for user `4159fa3b465c4d03b847f3456fe6af51`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:29.839698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.872494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760354-5144-4b94-a2bd-a3f49878d9d0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.898327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:29.960279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1051/2109] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:29.961551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:29.964420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:29.970268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.970908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.971157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.971637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.972561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:29.974725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:29.979603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184ae1-a057-479e-bb67-69dacebdc475 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:29.996965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:29.997649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:29.998004 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:29.998355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] PATH_INFO: `/v3/projects/ce2ff85c3e9e4d8c8461ec635a6c792f` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:29.999742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2ff85c3e9e4d8c8461ec635a6c792f)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.001758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.011552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1059/2110] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:29 2022] POST /identity/v3/users => generated 288 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:30.013493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.028454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aba8fc-e10e-40ea-8981-95b03f2e2eeb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.035493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.036105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.036394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.036637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.037279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.039196 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.057632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2ff85c3e9e4d8c8461ec635a6c792f', 'request_id': 'req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:30.065704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2ff85c3e9e4d8c8461ec635a6c792f', 'request_id': 'req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:30.069062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1060/2111] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:30.069784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.082839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2ff85c3e9e4d8c8461ec635a6c792f', 'request_id': 'req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:30.106094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] The token cache is being invalidate because project ce2ff85c3e9e4d8c8461ec635a6c792f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:30.108777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:30.109361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:30.113246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1052/2112] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:29 2022] DELETE /identity/v3/projects/ce2ff85c3e9e4d8c8461ec635a6c792f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:30.114442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.116457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:30.150543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d93390-0eaa-41d0-8291-181ffc92ada9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.156491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb577-ac87-41ca-a60b-d96707a72892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.157264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb577-ac87-41ca-a60b-d96707a72892 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.157614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb577-ac87-41ca-a60b-d96707a72892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.157961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb577-ac87-41ca-a60b-d96707a72892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.158719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb577-ac87-41ca-a60b-d96707a72892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.160820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb577-ac87-41ca-a60b-d96707a72892 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.176906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1061/2113] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:30.181111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.181682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.182061 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.203164 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee4c6-7139-4b61-8cf1-c59296d7f1c2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.205289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:30.207188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:30.215335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9774da0-1031-4807-9aee-40027ac15204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.215930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9774da0-1031-4807-9aee-40027ac15204 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.216209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9774da0-1031-4807-9aee-40027ac15204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.216482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9774da0-1031-4807-9aee-40027ac15204 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.217125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9774da0-1031-4807-9aee-40027ac15204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.219093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9774da0-1031-4807-9aee-40027ac15204 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.225973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1062/2114] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:30.225973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.225973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:30.237009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e547c-cf7d-4513-bbc5-6674810ed971 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.242383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.243245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.243650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.243990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.244714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.246392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.247222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1053/2115] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:30.251266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cdcf8-672d-4ff7-9a68-3554ad1a51f6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.251587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cdcf8-672d-4ff7-9a68-3554ad1a51f6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.251917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cdcf8-672d-4ff7-9a68-3554ad1a51f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.259872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1063/2116] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:30.261451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.281151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21818177-4c57-4e81-8bee-533d4ef9a3e8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.282177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2a3cdcf8-672d-4ff7-9a68-3554ad1a51f6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:30.283566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2a3cdcf8-672d-4ff7-9a68-3554ad1a51f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:30.288404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.290756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.291617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.292197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.292313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1054/2117] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:30.293015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cdcf8-672d-4ff7-9a68-3554ad1a51f6 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.293588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.295518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.301770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:30.304903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cdcf8-672d-4ff7-9a68-3554ad1a51f6 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.311464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1064/2118] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:30.312748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.314861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.315749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.316212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.316509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] PATH_INFO: `/v3/projects/234f45ef04ee4076a33df409209a9602/users/dee432a183a448e78be5da47afdcb704/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.326772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419d15-3c1c-42fa-851e-e2bcfd6c054a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.333595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.334210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.334489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.334759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.335619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:30.335939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.337602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.339252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] RBAC: Authorizing `identity:create_grant(project_id=234f45ef04ee4076a33df409209a9602, user_id=dee432a183a448e78be5da47afdcb704, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.342117 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.354226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1065/2119] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:30.354226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.360246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1055/2120] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:30 2022] PUT /identity/v3/projects/234f45ef04ee4076a33df409209a9602/users/dee432a183a448e78be5da47afdcb704/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:30.364421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4b6b-359f-4539-b63d-357c1c69c69b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.374783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.403642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:30.448334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253a6f9-a9c8-466d-a2e5-ee4b5b39bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.449044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253a6f9-a9c8-466d-a2e5-ee4b5b39bc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.449326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253a6f9-a9c8-466d-a2e5-ee4b5b39bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.449646 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253a6f9-a9c8-466d-a2e5-ee4b5b39bc35 admin admin] PATH_INFO: `/v3/projects/d977c6e2f755451ea3a42bc19fb11ec4/users/a642bbca4ea442b3b879773472846dd9/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.470531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253a6f9-a9c8-466d-a2e5-ee4b5b39bc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d977c6e2f755451ea3a42bc19fb11ec4, user_id=a642bbca4ea442b3b879773472846dd9, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.470677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e197e-58d2-4ea8-84a8-16c676e6484e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.471087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253a6f9-a9c8-466d-a2e5-ee4b5b39bc35 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.475529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.476203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.476673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.476970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.477710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.480252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.485360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1066/2121] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:30 2022] PUT /identity/v3/projects/d977c6e2f755451ea3a42bc19fb11ec4/users/a642bbca4ea442b3b879773472846dd9/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:30.486698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a9360-5c69-4ebf-9db1-1ac848ff8bd7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.487046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a9360-5c69-4ebf-9db1-1ac848ff8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.487534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a9360-5c69-4ebf-9db1-1ac848ff8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.513768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1056/2122] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:30.513768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.517829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-718a9360-5c69-4ebf-9db1-1ac848ff8bd7 None None] MFA Rules not processed for user `dee432a183a448e78be5da47afdcb704`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:30.519179 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-718a9360-5c69-4ebf-9db1-1ac848ff8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:30.585442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b7ab7-7205-4157-bc74-8c84261d5b6c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.597502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1067/2123] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:30.598172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a9360-5c69-4ebf-9db1-1ac848ff8bd7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.604508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.606052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.607731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.608151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.608833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.612682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.613800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a9360-5c69-4ebf-9db1-1ac848ff8bd7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.619115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.619756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.620037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.620308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.620950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.623479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.624668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1057/2124] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:30.625521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.627192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:30.649687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1068/2125] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:30.650331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.663106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f85ff-76b5-45a9-8a79-012dcfad4d16 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.675221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.678313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.678313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.678313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] PATH_INFO: `/v3/projects/d977c6e2f755451ea3a42bc19fb11ec4/users/a642bbca4ea442b3b879773472846dd9/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.682143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d977c6e2f755451ea3a42bc19fb11ec4, user_id=a642bbca4ea442b3b879773472846dd9, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.684878 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.696624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1069/2126] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:30 2022] PUT /identity/v3/projects/d977c6e2f755451ea3a42bc19fb11ec4/users/a642bbca4ea442b3b879773472846dd9/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:30.696790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d92ca-de3e-4ba4-a04a-34ec3d1f41fe admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.705759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.782896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:30.798805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.799783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.800059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.800331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.812849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:30.830619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd0655-643f-47a2-8915-65ba20f9b856 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.842513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae55800-e7cf-4e1d-8f17-cee6d0c541d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.843291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae55800-e7cf-4e1d-8f17-cee6d0c541d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.843699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae55800-e7cf-4e1d-8f17-cee6d0c541d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.844070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae55800-e7cf-4e1d-8f17-cee6d0c541d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.844852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae55800-e7cf-4e1d-8f17-cee6d0c541d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.846590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae55800-e7cf-4e1d-8f17-cee6d0c541d3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.861573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1070/2127] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:30.861573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.861573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.861573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.906800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] MFA Rules not processed for user `a642bbca4ea442b3b879773472846dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:30.910019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:30.923405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.925388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:30.939527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1058/2128] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:30.940590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:30.951408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f637a-37fd-4861-9c80-369cfe0d5a5f service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:30.956802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:30.957444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:30.957895 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:30.958175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:30.958826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:30.960637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:31.001888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1059/2129] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:31.008562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:31.023414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1071/2130] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:31.024401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd53f5-a0d5-4ba3-b537-89a3e9b0685f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:31.031032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b1a47-22b3-4829-9fed-a1040e39d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:31.032169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1a47-22b3-4829-9fed-a1040e39d27c admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:31.032451 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1a47-22b3-4829-9fed-a1040e39d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:31.032726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1a47-22b3-4829-9fed-a1040e39d27c admin admin] PATH_INFO: `/v3/projects/fa218303613443d183d485e65555f440/users/b44a5e9e36cd4a5cb5cef46f77ed5011/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:31.035869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:31.037553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:31.050030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b1a47-22b3-4829-9fed-a1040e39d27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa218303613443d183d485e65555f440, user_id=b44a5e9e36cd4a5cb5cef46f77ed5011, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:31.053522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b1a47-22b3-4829-9fed-a1040e39d27c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:31.059966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4ad81-9180-4eeb-af9b-c39a5422c997 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:31.067824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:31.068745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:31.068855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1060/2131] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:31 2022] PUT /identity/v3/projects/fa218303613443d183d485e65555f440/users/b44a5e9e36cd4a5cb5cef46f77ed5011/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:31.070630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:31.071972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:31.076251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:31.081141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6adc-ebf1-4b08-833a-51ea4c54522e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:31.081429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6adc-ebf1-4b08-833a-51ea4c54522e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:31.081705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6adc-ebf1-4b08-833a-51ea4c54522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:31.119894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d6ad6adc-ebf1-4b08-833a-51ea4c54522e None None] MFA Rules not processed for user `b44a5e9e36cd4a5cb5cef46f77ed5011`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:31.121609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d6ad6adc-ebf1-4b08-833a-51ea4c54522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:31.175582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:31.177305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:31.207949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1072/2132] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:31.222447 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1061/2133] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:31.374155 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:31.384065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70807a-7074-4b12-9e0d-f365b196b504 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:31.465935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:31.487145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:31.488651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:31.489812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:31.490791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:31.505197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:31.506901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:31.520211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1073/2134] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:33.137176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6adc-ebf1-4b08-833a-51ea4c54522e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:33.157657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6adc-ebf1-4b08-833a-51ea4c54522e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:33.168643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:33.169609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:33.170054 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:33.170489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:33.177111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:33.329823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:33.331645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:33.356792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1062/2135] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:33.784018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:33.785683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:33.864651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8b7b8-3a9f-422f-8fa5-0ab3aa7a9bde service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:33.869596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:33.870225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:33.870500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:33.870767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] PATH_INFO: `/v3/users/7a9617d57a1c4d06a0c5359a4b1907e2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:33.871920 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9617d57a1c4d06a0c5359a4b1907e2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:33.874033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:33.927633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9617d57a1c4d06a0c5359a4b1907e2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:33.938259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9617d57a1c4d06a0c5359a4b1907e2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:33.950834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9617d57a1c4d06a0c5359a4b1907e2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:33.951620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9617d57a1c4d06a0c5359a4b1907e2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:33.952301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9617d57a1c4d06a0c5359a4b1907e2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:33.965536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1074/2136] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:33 2022] DELETE /identity/v3/users/7a9617d57a1c4d06a0c5359a4b1907e2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:34.100618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.106270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:34.112082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4ad75-8436-42a8-ab9b-74c6c526e0f3 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.182648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc51013-212e-475e-98cf-72c84feace35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.183232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.183362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc51013-212e-475e-98cf-72c84feace35 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.183571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc51013-212e-475e-98cf-72c84feace35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.183841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc51013-212e-475e-98cf-72c84feace35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.184758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.185635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7dc51013-212e-475e-98cf-72c84feace35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.286224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d2f0-93d4-4a7b-8f43-65fe46c7f9f7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.292459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.293308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.293474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.293649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] PATH_INFO: `/v3/projects/f1080ec3f4d0454ebd2375efd628ab1f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.294792 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1080ec3f4d0454ebd2375efd628ab1f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.296777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.304351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc51013-212e-475e-98cf-72c84feace35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.305831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc51013-212e-475e-98cf-72c84feace35 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.310730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:34.315682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1063/2137] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:34.351027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1080ec3f4d0454ebd2375efd628ab1f', 'request_id': 'req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.359737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1080ec3f4d0454ebd2375efd628ab1f', 'request_id': 'req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.366303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1080ec3f4d0454ebd2375efd628ab1f', 'request_id': 'req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.393411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] The token cache is being invalidate because project f1080ec3f4d0454ebd2375efd628ab1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:34.393732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.394489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.396036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1075/2138] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:34 2022] DELETE /identity/v3/projects/f1080ec3f4d0454ebd2375efd628ab1f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:34.402103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5560f8-82a4-4ecb-8f1e-ee9980097958 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.402737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5560f8-82a4-4ecb-8f1e-ee9980097958 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.403088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5560f8-82a4-4ecb-8f1e-ee9980097958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.444555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.444872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2c5560f8-82a4-4ecb-8f1e-ee9980097958 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:34.446602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2c5560f8-82a4-4ecb-8f1e-ee9980097958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.447826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.527108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1064/2139] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:34.535482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b94a49-4a6e-42b0-a5e0-3e1ff4674915 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.535768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b94a49-4a6e-42b0-a5e0-3e1ff4674915 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.536043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b94a49-4a6e-42b0-a5e0-3e1ff4674915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.551849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4cb8f-88cc-4a4c-b7f4-ac98eb36baf6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.557701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.558345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.558622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.558893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] PATH_INFO: `/v3/users/b44a5e9e36cd4a5cb5cef46f77ed5011` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.560187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44a5e9e36cd4a5cb5cef46f77ed5011)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.562123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.582162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-b9b94a49-4a6e-42b0-a5e0-3e1ff4674915 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:34.583527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b9b94a49-4a6e-42b0-a5e0-3e1ff4674915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.594445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1065/2140] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:34.598923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b94a49-4a6e-42b0-a5e0-3e1ff4674915 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.609708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b94a49-4a6e-42b0-a5e0-3e1ff4674915 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.615785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.616508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.617052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.617361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.618026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:34.618327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.620027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.626697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44a5e9e36cd4a5cb5cef46f77ed5011'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.632624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1066/2141] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:23:34.634274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44a5e9e36cd4a5cb5cef46f77ed5011'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.637873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.646698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44a5e9e36cd4a5cb5cef46f77ed5011'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.647434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44a5e9e36cd4a5cb5cef46f77ed5011'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.648002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fa6b-7f7d-4963-a481-ecea5d10285b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.648114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-154d0a2b-af75-4a96-bfcd-0801fbb52cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44a5e9e36cd4a5cb5cef46f77ed5011'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:34.653439 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.653999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.654277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.654550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.655181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.657185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.661715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1076/2142] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:34 2022] DELETE /identity/v3/users/b44a5e9e36cd4a5cb5cef46f77ed5011 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:34.665888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.666175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.666447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.689218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1067/2143] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:34 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:34.689413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:34.689413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.690384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.692188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.701772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:34.707016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:34.757315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1077/2144] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:34.763820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc7903-85ae-446e-84b8-46d4123ab744 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.766933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.768390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:34.768637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.769244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.769522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.769792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.770456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.772426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.801252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1068/2145] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:34 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:34.805974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.816068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963b470-67ef-4dc5-90b6-8cc0a37a33a4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.821232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.821813 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.822092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.822363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.823001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.824652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.829286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43f59-7ada-4048-b069-9bd701b7a6fe None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.833707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.834510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.834786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.835028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1069/2146] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:34.837971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.838903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.848336 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.849811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f2759-9b32-420b-8bde-409cce2de037 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.849943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.855154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec208d-a141-4333-b352-38f877dac0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.855797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec208d-a141-4333-b352-38f877dac0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.856077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec208d-a141-4333-b352-38f877dac0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.856381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec208d-a141-4333-b352-38f877dac0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.857019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec208d-a141-4333-b352-38f877dac0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.858601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec208d-a141-4333-b352-38f877dac0ab admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.860508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1078/2147] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:34.870541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1070/2148] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:34.874624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:34.884203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31160c0-9087-4cb7-ae15-fe3e780c5d3d service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:34.888836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:34.889536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.889835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.890108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] PATH_INFO: `/v3/projects/04d38b616d8d429ab1c7b13b25e856d5/users/47bcae964108425b9b3216200e21b2f7/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.911174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d38b616d8d429ab1c7b13b25e856d5, user_id=47bcae964108425b9b3216200e21b2f7, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:34.914853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:34.928640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1079/2149] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:34 2022] PUT /identity/v3/projects/04d38b616d8d429ab1c7b13b25e856d5/users/47bcae964108425b9b3216200e21b2f7/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:34.939861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:34.940371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:34.940731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:34.975924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] MFA Rules not processed for user `47bcae964108425b9b3216200e21b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:34.977665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:35.059761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1071/2150] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:35.064229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.134991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9f37-1060-4ffe-bb0f-d7456aa3f919 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.139841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.140448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.140832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.141117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.141784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.143915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.151675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.153405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:35.169519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a9424-64a2-41da-b13b-5edd66fc68d4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.175355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.176410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.176410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.179675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1080/2151] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:35 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:35.180132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] PATH_INFO: `/v3/projects/fa218303613443d183d485e65555f440` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.180132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa218303613443d183d485e65555f440)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.181374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.186505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.218197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:35.232595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa218303613443d183d485e65555f440', 'request_id': 'req-bcfea224-5758-4ab6-83c7-63d9f0c0480b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:35.242459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa218303613443d183d485e65555f440', 'request_id': 'req-bcfea224-5758-4ab6-83c7-63d9f0c0480b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:35.249938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa218303613443d183d485e65555f440', 'request_id': 'req-bcfea224-5758-4ab6-83c7-63d9f0c0480b'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:35.251207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:35.265060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] The token cache is being invalidate because project fa218303613443d183d485e65555f440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:35.265399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:35.265520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74888d-e406-456f-9cf6-03769af6334a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.266397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:35.267956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1072/2152] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:35 2022] DELETE /identity/v3/projects/fa218303613443d183d485e65555f440 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:35.347964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.349071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.349356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.349634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.350309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.352953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.378440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1081/2153] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:35 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:35.383923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.385691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:35.405496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea224-5758-4ab6-83c7-63d9f0c0480b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.410419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.411108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.411490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.411767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.412604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.414678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.425987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1073/2154] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:35.430369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.443448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442876c-33d6-404d-9a47-013e24d5e12b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.450208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.451076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.451349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.451845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] PATH_INFO: `/v3/projects/4750dc97fe21406b97577bb96a80b15e/users/4e62587351ee4cb48eda602a6fb2060a/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.472098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4750dc97fe21406b97577bb96a80b15e, user_id=4e62587351ee4cb48eda602a6fb2060a, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.478121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.492127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1082/2155] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:35 2022] PUT /identity/v3/projects/4750dc97fe21406b97577bb96a80b15e/users/4e62587351ee4cb48eda602a6fb2060a/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:35.496377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.506605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63a5d5-1eb4-4133-8e3d-e9c4a8c7d5a8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.565252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176d0b0-501e-4be1-b44e-bd8e9fd72cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.565870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d0b0-501e-4be1-b44e-bd8e9fd72cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.566255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d0b0-501e-4be1-b44e-bd8e9fd72cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.566430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d0b0-501e-4be1-b44e-bd8e9fd72cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.567086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176d0b0-501e-4be1-b44e-bd8e9fd72cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.568737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176d0b0-501e-4be1-b44e-bd8e9fd72cb0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.581845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1074/2156] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:35.585905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.598298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5550e75-51cd-4068-b1d4-b8df9de2dc0a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.607256 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.608624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.608624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.608909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] PATH_INFO: `/v3/projects/4750dc97fe21406b97577bb96a80b15e/users/4e62587351ee4cb48eda602a6fb2060a/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.611612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4750dc97fe21406b97577bb96a80b15e, user_id=4e62587351ee4cb48eda602a6fb2060a, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.614597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.640998 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1083/2157] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:35 2022] PUT /identity/v3/projects/4750dc97fe21406b97577bb96a80b15e/users/4e62587351ee4cb48eda602a6fb2060a/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:35.656249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a7ee0-a816-4792-a8c3-deff5aa7d47e None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.656586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a7ee0-a816-4792-a8c3-deff5aa7d47e None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.657580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a7ee0-a816-4792-a8c3-deff5aa7d47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.692853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c07a7ee0-a816-4792-a8c3-deff5aa7d47e None None] MFA Rules not processed for user `4e62587351ee4cb48eda602a6fb2060a`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:35.694071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c07a7ee0-a816-4792-a8c3-deff5aa7d47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:35.801231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1075/2158] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:35.810996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:35.812888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:35.873597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae2b8-9803-41aa-8243-1eefe72472b6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:35.877322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64949f01-e701-4d53-a7b3-c94b15829b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:35.877925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64949f01-e701-4d53-a7b3-c94b15829b3a service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:35.878204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64949f01-e701-4d53-a7b3-c94b15829b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:35.878473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64949f01-e701-4d53-a7b3-c94b15829b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:35.887342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64949f01-e701-4d53-a7b3-c94b15829b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:35.888799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64949f01-e701-4d53-a7b3-c94b15829b3a service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:35.898276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1084/2159] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:37.318111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a7ee0-a816-4792-a8c3-deff5aa7d47e None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:37.381165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a7ee0-a816-4792-a8c3-deff5aa7d47e None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:37.387222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:37.388174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:37.388404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:37.388759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] PATH_INFO: `/v3/users/47bcae964108425b9b3216200e21b2f7` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:37.390170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bcae964108425b9b3216200e21b2f7)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:37.392179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:37.397051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:37.446712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bcae964108425b9b3216200e21b2f7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:37.454036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bcae964108425b9b3216200e21b2f7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:37.466301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bcae964108425b9b3216200e21b2f7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:37.467034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bcae964108425b9b3216200e21b2f7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:37.467665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bcae964108425b9b3216200e21b2f7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:37.480418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1076/2160] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:37 2022] DELETE /identity/v3/users/47bcae964108425b9b3216200e21b2f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:37.484884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:37.485358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:37.485453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:37.504997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:37.506128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:37.529194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:37.574255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1085/2161] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:37.581011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:37.582616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:37.650765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e98819-1c01-47da-a290-f76c431529f6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:37.654529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:37.655260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:37.655660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:37.655956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:37.665505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:37.666930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:37.676450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1077/2162] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:37.984721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:37.986362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:38.001164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9708-1ab0-4e2b-9661-7b84bf069eb6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:38.006686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:38.007330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.007657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.008512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] PATH_INFO: `/v3/projects/04d38b616d8d429ab1c7b13b25e856d5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.009659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d38b616d8d429ab1c7b13b25e856d5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:38.011650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:38.062324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d38b616d8d429ab1c7b13b25e856d5', 'request_id': 'req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.069981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d38b616d8d429ab1c7b13b25e856d5', 'request_id': 'req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.076724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d38b616d8d429ab1c7b13b25e856d5', 'request_id': 'req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.088088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] The token cache is being invalidate because project 04d38b616d8d429ab1c7b13b25e856d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:38.088374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.089030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.090544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1086/2163] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:37 2022] DELETE /identity/v3/projects/04d38b616d8d429ab1c7b13b25e856d5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:38.094531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:38.104640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0e5a-d311-4566-a32f-5a2f86fb04c5 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:38.165836 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:38.166480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.166762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.167034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] PATH_INFO: `/v3/users/4e62587351ee4cb48eda602a6fb2060a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.168260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e62587351ee4cb48eda602a6fb2060a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:38.170253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:38.208505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:38.230158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e62587351ee4cb48eda602a6fb2060a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.239079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e62587351ee4cb48eda602a6fb2060a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.252517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e62587351ee4cb48eda602a6fb2060a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.253258 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e62587351ee4cb48eda602a6fb2060a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.254156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9f09c5c0-63d8-4ea7-9d68-8827c8faf5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e62587351ee4cb48eda602a6fb2060a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.275897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1078/2164] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:38 2022] DELETE /identity/v3/users/4e62587351ee4cb48eda602a6fb2060a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:38.319421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:38.321149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:38.338033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db35c66-0ff0-4c20-8c8b-e561d9def3f0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:38.419290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:38.420107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.420390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.420661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] PATH_INFO: `/v3/users/10accf97ecb946788d347567746da534` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.421877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10accf97ecb946788d347567746da534)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:38.424412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:38.480268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10accf97ecb946788d347567746da534'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.484727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:38.487789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10accf97ecb946788d347567746da534'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.503208 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10accf97ecb946788d347567746da534'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.503986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10accf97ecb946788d347567746da534'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.504844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10accf97ecb946788d347567746da534'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.519397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1087/2165] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:38 2022] DELETE /identity/v3/users/10accf97ecb946788d347567746da534 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:38.524028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.524498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.524711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.550106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:38.551266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:38.585197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:38.588421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:38.619846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1079/2166] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:38.629579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:38.630931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:38.670997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf54cd-6972-4847-a69c-73c5258026d0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:38.680231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:38.680231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.680231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.680231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] PATH_INFO: `/v3/projects/4750dc97fe21406b97577bb96a80b15e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.680717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4750dc97fe21406b97577bb96a80b15e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:38.680717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:38.696234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bc7d0-31a5-4894-a749-37b81a6fffa1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:38.700011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8f6fd-f061-458f-b015-ae260bad8b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:38.700699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f6fd-f061-458f-b015-ae260bad8b6e service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.700977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f6fd-f061-458f-b015-ae260bad8b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.701355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f6fd-f061-458f-b015-ae260bad8b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.710432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8f6fd-f061-458f-b015-ae260bad8b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:38.713053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8f6fd-f061-458f-b015-ae260bad8b6e service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:38.722529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1080/2167] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:38.728411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4750dc97fe21406b97577bb96a80b15e', 'request_id': 'req-c5cac1fa-9c35-4eed-93e9-2667db6e4838'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.736635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4750dc97fe21406b97577bb96a80b15e', 'request_id': 'req-c5cac1fa-9c35-4eed-93e9-2667db6e4838'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.745238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4750dc97fe21406b97577bb96a80b15e', 'request_id': 'req-c5cac1fa-9c35-4eed-93e9-2667db6e4838'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.758259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] The token cache is being invalidate because project 4750dc97fe21406b97577bb96a80b15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:38.758634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.759698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5cac1fa-9c35-4eed-93e9-2667db6e4838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:38.761618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1088/2168] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:38 2022] DELETE /identity/v3/projects/4750dc97fe21406b97577bb96a80b15e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:38.766668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e3dc-50a7-4c73-a2f2-be33202fe281 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.767058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e3dc-50a7-4c73-a2f2-be33202fe281 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.767415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e3dc-50a7-4c73-a2f2-be33202fe281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.794291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9d95e3dc-50a7-4c73-a2f2-be33202fe281 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:38.797111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9d95e3dc-50a7-4c73-a2f2-be33202fe281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:38.850769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:38.870279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1081/2169] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:38.878083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0583-ff68-4886-be67-addb2640464e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.878371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0583-ff68-4886-be67-addb2640464e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.878644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0583-ff68-4886-be67-addb2640464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.900225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f22c0583-ff68-4886-be67-addb2640464e None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:38.901547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f22c0583-ff68-4886-be67-addb2640464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:38.909666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1089/2170] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:38.913866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e3dc-50a7-4c73-a2f2-be33202fe281 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:38.923794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e3dc-50a7-4c73-a2f2-be33202fe281 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:38.928511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:38.929110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.929390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.930199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.930845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:38.931149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:38.932819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:38.951116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1082/2171] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:38.955518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c0583-ff68-4886-be67-addb2640464e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:38.965388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c0583-ff68-4886-be67-addb2640464e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:38.970232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:38.970838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:38.971115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:38.971409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:38.972207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:38.974190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.019692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1090/2172] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:38 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:39.020731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.034238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6419-e7f2-4a2f-9810-503813993e60 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.040945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.044249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:39.087756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:39.131237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.132110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.132421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.133221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.133877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.134364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64320a-0d91-4873-aabb-49b10fe03e87 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.135864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.140752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.141520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.141854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.142128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] PATH_INFO: `/v3/projects/d39443107f214449a0bcd083be081d04` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.143251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39443107f214449a0bcd083be081d04)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.145186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.161773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1083/2173] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:39 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:39.166983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.177660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92e2a6-8fe4-4b48-b93f-b1de276fa06c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.184399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.185176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.185541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.185963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.186671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.188546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.203482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1084/2174] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:39.206246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.213118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39443107f214449a0bcd083be081d04', 'request_id': 'req-7621e0ba-8489-4a9e-a2d8-c178775a805c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.225915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2db457-1cf1-4d38-b192-7c088e648d10 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.227788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39443107f214449a0bcd083be081d04', 'request_id': 'req-7621e0ba-8489-4a9e-a2d8-c178775a805c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.238834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39443107f214449a0bcd083be081d04', 'request_id': 'req-7621e0ba-8489-4a9e-a2d8-c178775a805c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.256851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] The token cache is being invalidate because project d39443107f214449a0bcd083be081d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:39.257268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.258540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.260090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1091/2175] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:39 2022] DELETE /identity/v3/projects/d39443107f214449a0bcd083be081d04 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:39.263850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.265214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:39.298967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.299775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.300155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.300525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.301269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.302979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.316449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1085/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:39.317723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.319493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:39.332479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798afc-e3e9-4ac9-ab2b-9d96f2c0e006 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.332636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e0ba-8489-4a9e-a2d8-c178775a805c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.337923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.338143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204b82d-801d-4961-93da-60fa266acf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.338661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.338758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b82d-801d-4961-93da-60fa266acf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.338944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.339046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b82d-801d-4961-93da-60fa266acf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.339216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] PATH_INFO: `/v3/users/4159fa3b465c4d03b847f3456fe6af51` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.339310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b82d-801d-4961-93da-60fa266acf69 admin admin] PATH_INFO: `/v3/projects/c52c54aadf6a4481b09ebfab7f942aef/users/d0ee5a9fa8024be78c0ce754cceafaf9/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.340429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4159fa3b465c4d03b847f3456fe6af51)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.342345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.354855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204b82d-801d-4961-93da-60fa266acf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52c54aadf6a4481b09ebfab7f942aef, user_id=d0ee5a9fa8024be78c0ce754cceafaf9, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.357602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204b82d-801d-4961-93da-60fa266acf69 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.372923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1086/2177] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:39 2022] PUT /identity/v3/projects/c52c54aadf6a4481b09ebfab7f942aef/users/d0ee5a9fa8024be78c0ce754cceafaf9/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:39.384995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd28af-a5ab-4597-9a57-992fc1fb52bf None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.385281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd28af-a5ab-4597-9a57-992fc1fb52bf None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.385625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd28af-a5ab-4597-9a57-992fc1fb52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.393583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4159fa3b465c4d03b847f3456fe6af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.402409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4159fa3b465c4d03b847f3456fe6af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.408055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:39.416498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4159fa3b465c4d03b847f3456fe6af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.417589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4159fa3b465c4d03b847f3456fe6af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.417969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9fbd28af-a5ab-4597-9a57-992fc1fb52bf None None] MFA Rules not processed for user `d0ee5a9fa8024be78c0ce754cceafaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:39.418234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4159fa3b465c4d03b847f3456fe6af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.419220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9fbd28af-a5ab-4597-9a57-992fc1fb52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:39.431067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1092/2178] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:39 2022] DELETE /identity/v3/users/4159fa3b465c4d03b847f3456fe6af51 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:39.433496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:39.511921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1087/2179] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:39.517081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.518785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:39.593873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a4d95-e07e-4ea8-a87e-17f887c8812b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.600008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.600661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.600942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.601347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.602046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.604035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.638056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1093/2180] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:39 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:39.647562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd28af-a5ab-4597-9a57-992fc1fb52bf None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.714609 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd28af-a5ab-4597-9a57-992fc1fb52bf None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.743517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.745876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:39.787500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.788124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.788406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.788678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.789900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.791884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.816282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1088/2181] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:39 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:39.817276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.823098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e0099-b50d-45d9-986e-3d88afa2d0e1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.827366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df62b-99e8-489c-b609-39dce2b0f3f6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.827828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.828459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.828743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.829017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] PATH_INFO: `/v3/projects/1ecd632edfc441da8dd8600efed94713` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.830133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecd632edfc441da8dd8600efed94713)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.832122 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.832355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.833167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.833277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.833548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.838906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.838906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.851422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1089/2182] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:39.853332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.865897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f56e75-4f18-4115-bbaf-d8cf9f3dcbad admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.876388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.877083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.877359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.877634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] PATH_INFO: `/v3/projects/95d6c36bc555490b85fe2c3685b5e87f/users/2b18bead22dc4dd09c87cbef8bb89b25/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.890613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecd632edfc441da8dd8600efed94713', 'request_id': 'req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.896756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d6c36bc555490b85fe2c3685b5e87f, user_id=2b18bead22dc4dd09c87cbef8bb89b25, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.899219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecd632edfc441da8dd8600efed94713', 'request_id': 'req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.899831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:39.909702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecd632edfc441da8dd8600efed94713', 'request_id': 'req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.911821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:39.917357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1090/2183] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:39 2022] PUT /identity/v3/projects/95d6c36bc555490b85fe2c3685b5e87f/users/2b18bead22dc4dd09c87cbef8bb89b25/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:39.921413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.925470 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] The token cache is being invalidate because project 1ecd632edfc441da8dd8600efed94713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:39.925825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.926752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:39.928378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1094/2184] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:39 2022] DELETE /identity/v3/projects/1ecd632edfc441da8dd8600efed94713 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:39.932722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:39.934156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:39.941442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:39.985924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bb88b-c61c-436d-bffa-9dbeff4a46d8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:39.990921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:39.991841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:39.992704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:39.992977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:39.998357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:39.998357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.006384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1091/2185] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:40.009346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255cc6a-73f2-430a-86ab-88d0e3a3f5cf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:40.010505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:40.012270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:40.014307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:40.014943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.015224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.015535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] PATH_INFO: `/v3/users/a642bbca4ea442b3b879773472846dd9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.016684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a642bbca4ea442b3b879773472846dd9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:40.018745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.025149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370aebee-66b4-4fc9-8f02-9294e3907f64 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:40.029885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f358b13-c495-4a84-ad34-0ad03f1b4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:40.030555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f358b13-c495-4a84-ad34-0ad03f1b4703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.030833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f358b13-c495-4a84-ad34-0ad03f1b4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.031137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f358b13-c495-4a84-ad34-0ad03f1b4703 admin admin] PATH_INFO: `/v3/projects/95d6c36bc555490b85fe2c3685b5e87f/users/2b18bead22dc4dd09c87cbef8bb89b25/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.033063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f358b13-c495-4a84-ad34-0ad03f1b4703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d6c36bc555490b85fe2c3685b5e87f, user_id=2b18bead22dc4dd09c87cbef8bb89b25, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:40.036269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f358b13-c495-4a84-ad34-0ad03f1b4703 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.046438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1092/2186] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:40 2022] PUT /identity/v3/projects/95d6c36bc555490b85fe2c3685b5e87f/users/2b18bead22dc4dd09c87cbef8bb89b25/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:40.058825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f57b-edff-4d02-a93b-bee94f8daa01 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.059130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f57b-edff-4d02-a93b-bee94f8daa01 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.059405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f57b-edff-4d02-a93b-bee94f8daa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.076222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a642bbca4ea442b3b879773472846dd9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.083107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a642bbca4ea442b3b879773472846dd9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.087668 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a9c1f57b-edff-4d02-a93b-bee94f8daa01 None None] MFA Rules not processed for user `2b18bead22dc4dd09c87cbef8bb89b25`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:40.089690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a9c1f57b-edff-4d02-a93b-bee94f8daa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:40.097712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a642bbca4ea442b3b879773472846dd9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.098715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a642bbca4ea442b3b879773472846dd9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.099680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a642bbca4ea442b3b879773472846dd9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.118389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1095/2187] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:39 2022] DELETE /identity/v3/users/a642bbca4ea442b3b879773472846dd9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:40.167437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1093/2188] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:40.179274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:40.181482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:40.248531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad40955-daff-4f72-aea2-2b354d4dd332 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:40.252225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:40.252860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.253140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.253410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.294409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:40.348950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:40.350595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.364866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1096/2189] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:40.424938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1f57b-edff-4d02-a93b-bee94f8daa01 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:40.438992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:40.442859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:40.506555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1f57b-edff-4d02-a93b-bee94f8daa01 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:40.511731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e34f4e-b8e6-407a-bd5c-3e4314ea0856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:40.512778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34f4e-b8e6-407a-bd5c-3e4314ea0856 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.513638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34f4e-b8e6-407a-bd5c-3e4314ea0856 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.513999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34f4e-b8e6-407a-bd5c-3e4314ea0856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.516181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-66e34f4e-b8e6-407a-bd5c-3e4314ea0856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:40.533900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4e002-7f8b-45bd-bf85-bdf84fa2a888 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:40.538804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:40.540158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.540542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.541092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] PATH_INFO: `/v3/projects/d977c6e2f755451ea3a42bc19fb11ec4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.542183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d977c6e2f755451ea3a42bc19fb11ec4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:40.544271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.564077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:40.593041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e34f4e-b8e6-407a-bd5c-3e4314ea0856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:40.594510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e34f4e-b8e6-407a-bd5c-3e4314ea0856 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.605374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1094/2190] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:40.607758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd977c6e2f755451ea3a42bc19fb11ec4', 'request_id': 'req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.617536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd977c6e2f755451ea3a42bc19fb11ec4', 'request_id': 'req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.623931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd977c6e2f755451ea3a42bc19fb11ec4', 'request_id': 'req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.638305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] The token cache is being invalidate because project d977c6e2f755451ea3a42bc19fb11ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:40.639558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.640278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0a4a1722-a132-4430-9a26-c2fcdbd53ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:40.644308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1097/2191] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:40 2022] DELETE /identity/v3/projects/d977c6e2f755451ea3a42bc19fb11ec4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:40.653265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b6675-806d-40be-917b-0c7ee9a27311 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.653756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b6675-806d-40be-917b-0c7ee9a27311 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.653846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b6675-806d-40be-917b-0c7ee9a27311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.722703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-903b6675-806d-40be-917b-0c7ee9a27311 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:40.724052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-903b6675-806d-40be-917b-0c7ee9a27311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:40.828112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1095/2192] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:40.840710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24599c1-65ae-4a0f-b46b-bfbd9f4c1180 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.841334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24599c1-65ae-4a0f-b46b-bfbd9f4c1180 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.841741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24599c1-65ae-4a0f-b46b-bfbd9f4c1180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.864566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f24599c1-65ae-4a0f-b46b-bfbd9f4c1180 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:40.865786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f24599c1-65ae-4a0f-b46b-bfbd9f4c1180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:40.875409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1098/2193] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:40.881027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b6675-806d-40be-917b-0c7ee9a27311 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:40.890531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b6675-806d-40be-917b-0c7ee9a27311 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:40.896176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:40.896985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.897272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.897887 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.898427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:40.898599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:40.900294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.915821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1096/2194] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:40.920239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24599c1-65ae-4a0f-b46b-bfbd9f4c1180 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:40.930960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24599c1-65ae-4a0f-b46b-bfbd9f4c1180 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:40.935747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:40.937021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:40.937307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:40.937578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:40.938227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:40.940178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:40.983784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1099/2195] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:40 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:40.986833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:41.016738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2b0a4-9618-448c-9b94-381f435baa52 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:41.079149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:41.079783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:41.080065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:41.080339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:41.080968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:41.082919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:41.104752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1097/2196] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:40 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:41.108993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:41.120137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0c09-bb56-4bd5-96a2-d6ebf5c584cf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:41.124710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:41.125329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:41.125609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:41.125880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:41.126521 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:41.128193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:41.138069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1100/2197] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:41.141952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:41.152282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4f6c3-71cd-47fc-a0b3-967e205cf50f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:41.156884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a685a-e246-40d9-9a56-861cdfc6da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:41.157469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a685a-e246-40d9-9a56-861cdfc6da2a admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:41.157746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a685a-e246-40d9-9a56-861cdfc6da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:41.158016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a685a-e246-40d9-9a56-861cdfc6da2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:41.158652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a685a-e246-40d9-9a56-861cdfc6da2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:41.160371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a685a-e246-40d9-9a56-861cdfc6da2a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:41.171504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1098/2198] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:41.175477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:41.185567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444589a6-eb9b-4c24-9f8c-612ca30d06de admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:41.190257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:41.190893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:41.191172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:41.191492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] PATH_INFO: `/v3/projects/1a06a4fca452449b8c1e35047c145772/users/51af3e131caf4dd8b533816bb9abd4e2/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:41.203173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:41.206618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a06a4fca452449b8c1e35047c145772, user_id=51af3e131caf4dd8b533816bb9abd4e2, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:41.210417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:41.224988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1101/2199] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:41 2022] PUT /identity/v3/projects/1a06a4fca452449b8c1e35047c145772/users/51af3e131caf4dd8b533816bb9abd4e2/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:41.230744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8aa73-b10e-4547-8c9c-33046ba3bf95 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:41.231032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8aa73-b10e-4547-8c9c-33046ba3bf95 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:41.231307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8aa73-b10e-4547-8c9c-33046ba3bf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:41.250310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-cdd8aa73-b10e-4547-8c9c-33046ba3bf95 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:41.251570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cdd8aa73-b10e-4547-8c9c-33046ba3bf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:41.293152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:41.312214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1099/2200] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:41.322633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:41.324381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:41.380744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce96a3-a6fd-4916-85d1-bf28e7c7ac74 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:41.385534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:41.386304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:41.386649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:41.387029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:41.396281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:41.397713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:41.407395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1102/2201] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:42.048251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eab3f-c2d8-4b9e-863b-f5954ae91c5a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:42.048703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eab3f-c2d8-4b9e-863b-f5954ae91c5a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:42.048817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eab3f-c2d8-4b9e-863b-f5954ae91c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:42.119755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-ee7eab3f-c2d8-4b9e-863b-f5954ae91c5a None None] MFA Rules not processed for user `51af3e131caf4dd8b533816bb9abd4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:42.122713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ee7eab3f-c2d8-4b9e-863b-f5954ae91c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:42.238957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1100/2202] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:42.251852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:42.253313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:42.314115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a84e4-c52b-42ef-97e9-e3e317bc5cab service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:42.316506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:42.317111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:42.317383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:42.317649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:42.327226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:42.328688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:42.338830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1103/2203] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:43.747120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614f4a-5999-46e0-8d7f-66d90a698a8b None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:43.747747 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614f4a-5999-46e0-8d7f-66d90a698a8b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:43.747837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614f4a-5999-46e0-8d7f-66d90a698a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:43.767410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7b614f4a-5999-46e0-8d7f-66d90a698a8b None None] MFA Rules not processed for user `51af3e131caf4dd8b533816bb9abd4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:43.768934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7b614f4a-5999-46e0-8d7f-66d90a698a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:43.777245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1101/2204] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:44.160252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:44.161831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:44.177237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d004-732f-43b5-98e3-ea89dd98e587 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:44.183041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:44.183923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:44.184353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:44.184862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] PATH_INFO: `/v3/users/d0ee5a9fa8024be78c0ce754cceafaf9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:44.186472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ee5a9fa8024be78c0ce754cceafaf9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:44.188965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:44.253245 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ee5a9fa8024be78c0ce754cceafaf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.262159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ee5a9fa8024be78c0ce754cceafaf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.277241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ee5a9fa8024be78c0ce754cceafaf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.278042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ee5a9fa8024be78c0ce754cceafaf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.278715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ee5a9fa8024be78c0ce754cceafaf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.294121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1104/2205] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:44 2022] DELETE /identity/v3/users/d0ee5a9fa8024be78c0ce754cceafaf9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:44.299410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:44.299782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:44.300101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:44.326766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:44.328138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:44.414628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1102/2206] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:44.426944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:44.428398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:44.449984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:44.526352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9421-2ec9-4444-9746-2ba1e1ceb585 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:44.532605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:44.533422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:44.533787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:44.534211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:44.545858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:44.547801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:44.565818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1105/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:44.843888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:44.845429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:44.867977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d77cf-7366-47ad-b306-e6985c822874 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:44.873686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:44.874341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:44.874608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:44.874886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] PATH_INFO: `/v3/projects/c52c54aadf6a4481b09ebfab7f942aef` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:44.876176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52c54aadf6a4481b09ebfab7f942aef)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:44.878671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:44.928706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52c54aadf6a4481b09ebfab7f942aef', 'request_id': 'req-bf95d003-13e7-4e55-9752-1e11c3122d41'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.937100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52c54aadf6a4481b09ebfab7f942aef', 'request_id': 'req-bf95d003-13e7-4e55-9752-1e11c3122d41'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.943965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52c54aadf6a4481b09ebfab7f942aef', 'request_id': 'req-bf95d003-13e7-4e55-9752-1e11c3122d41'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.945163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:44.958184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] The token cache is being invalidate because project c52c54aadf6a4481b09ebfab7f942aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:44.958595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.959453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:44.962224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1103/2208] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:44 2022] DELETE /identity/v3/projects/c52c54aadf6a4481b09ebfab7f942aef => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:44.966457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:44.976749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b5d4e-7cdc-432d-8180-e7e84b639f11 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:45.037033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:45.037657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.037940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.038214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] PATH_INFO: `/v3/users/2b18bead22dc4dd09c87cbef8bb89b25` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.039389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b18bead22dc4dd09c87cbef8bb89b25)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:45.041329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:45.090364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b18bead22dc4dd09c87cbef8bb89b25'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.097225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b18bead22dc4dd09c87cbef8bb89b25'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.110517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b18bead22dc4dd09c87cbef8bb89b25'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.111263 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b18bead22dc4dd09c87cbef8bb89b25'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.112526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b18bead22dc4dd09c87cbef8bb89b25'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.126805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1106/2209] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:44 2022] DELETE /identity/v3/users/2b18bead22dc4dd09c87cbef8bb89b25 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:45.425979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:45.428313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:45.462247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d003-13e7-4e55-9752-1e11c3122d41 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:45.474562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:45.476787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:45.532653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:45.535167 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:45.535837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.536104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.536379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] PATH_INFO: `/v3/projects/95d6c36bc555490b85fe2c3685b5e87f` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.537569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d6c36bc555490b85fe2c3685b5e87f)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:45.540137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:45.569803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f515b-e067-45d5-b365-806f83b12f90 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:45.574699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:45.575980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.576266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.576540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] PATH_INFO: `/v3/users/dee432a183a448e78be5da47afdcb704` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.577681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee432a183a448e78be5da47afdcb704)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:45.579859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:45.608520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d6c36bc555490b85fe2c3685b5e87f', 'request_id': 'req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.617461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d6c36bc555490b85fe2c3685b5e87f', 'request_id': 'req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.627206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d6c36bc555490b85fe2c3685b5e87f', 'request_id': 'req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.637729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee432a183a448e78be5da47afdcb704'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.640769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] The token cache is being invalidate because project 95d6c36bc555490b85fe2c3685b5e87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:45.641332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.642006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8a8e6a0b-9f51-4889-b97b-a322c9f189fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.647445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1104/2210] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:45 2022] DELETE /identity/v3/projects/95d6c36bc555490b85fe2c3685b5e87f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:45.649589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee432a183a448e78be5da47afdcb704'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.649729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17bc52-3362-4895-869f-0c53639aa8b5 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.650085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17bc52-3362-4895-869f-0c53639aa8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.650523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17bc52-3362-4895-869f-0c53639aa8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.663416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee432a183a448e78be5da47afdcb704'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.664504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee432a183a448e78be5da47afdcb704'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.665119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53b13a77-21f2-4b4f-80ed-bf67717f9f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee432a183a448e78be5da47afdcb704'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:45.673577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-be17bc52-3362-4895-869f-0c53639aa8b5 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:45.674985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-be17bc52-3362-4895-869f-0c53639aa8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:45.680229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1107/2211] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:45 2022] DELETE /identity/v3/users/dee432a183a448e78be5da47afdcb704 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:45.684293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.684676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.684887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.706087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:45.707443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:45.752277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1105/2212] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:45.760020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259d75a-2924-4ec8-b7f7-502bab053e5a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.760303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259d75a-2924-4ec8-b7f7-502bab053e5a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.760575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259d75a-2924-4ec8-b7f7-502bab053e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.779987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1108/2213] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:45.784373 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1259d75a-2924-4ec8-b7f7-502bab053e5a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:45.785605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1259d75a-2924-4ec8-b7f7-502bab053e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:45.789812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:45.791156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:45.797769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1106/2214] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:45.798730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259d75a-2924-4ec8-b7f7-502bab053e5a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:45.810769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259d75a-2924-4ec8-b7f7-502bab053e5a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:45.815789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:45.816389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.816665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.817057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.817702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:45.818003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:45.819784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:45.835527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1107/2215] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:45.839643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:45.847678 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:45.852114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c077-06e1-4dac-bd62-a12cb8b1ac41 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:45.859209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:45.860068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.860521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.860990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.861825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:45.862511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb029-f729-42e2-855b-b596ab447f2c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:45.864099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:45.866301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:45.867733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:45.868011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:45.868279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:45.875198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:45.880691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:45.883319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:45.894924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1109/2216] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:45.895738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1108/2217] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:45 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:45.899803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:45.909747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2d16-d67a-4cce-9f5b-f3e998ef2157 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.010153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.011137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.011137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.011427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.012067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.013996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.039909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1110/2218] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:45 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:46.044149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.056457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030666d0-2b52-4a61-bbc6-8cb1b5e72ed0 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.062113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.062859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.063041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.063263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.064213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.068518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.082080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1109/2219] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:46.085892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.098349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda61f-9e1c-485e-acbb-b12b38495528 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.107674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d16f6-7165-4a7e-81b3-e90d4e9e9be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.109054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d16f6-7165-4a7e-81b3-e90d4e9e9be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.109474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d16f6-7165-4a7e-81b3-e90d4e9e9be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.110113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d16f6-7165-4a7e-81b3-e90d4e9e9be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.111009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d16f6-7165-4a7e-81b3-e90d4e9e9be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.113125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d16f6-7165-4a7e-81b3-e90d4e9e9be6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.128060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1111/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:46.129541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.143143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f68f8-a4ee-4eee-85b4-ff39953b2023 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.149478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.149865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.150638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.150638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] PATH_INFO: `/v3/projects/2a59998785524377b3ce0f3aa6b9ef85/users/2311c91a48a84db2adb59ddbce07128a/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.166387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a59998785524377b3ce0f3aa6b9ef85, user_id=2311c91a48a84db2adb59ddbce07128a, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.169440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.185797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1110/2221] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:46 2022] PUT /identity/v3/projects/2a59998785524377b3ce0f3aa6b9ef85/users/2311c91a48a84db2adb59ddbce07128a/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:46.198655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1801c3a-518d-44e5-a15b-4a4d076bbfb0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.198958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1801c3a-518d-44e5-a15b-4a4d076bbfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.199308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1801c3a-518d-44e5-a15b-4a4d076bbfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.215204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.220622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:46.238164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b1801c3a-518d-44e5-a15b-4a4d076bbfb0 None None] MFA Rules not processed for user `2311c91a48a84db2adb59ddbce07128a`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:46.239296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b1801c3a-518d-44e5-a15b-4a4d076bbfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:46.333206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb013-cdde-4f7a-ae5d-a34151555bcf admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.338712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.339340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.339645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.339915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] PATH_INFO: `/v3/projects/234f45ef04ee4076a33df409209a9602` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.341048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=234f45ef04ee4076a33df409209a9602)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.343434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.357632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1112/2222] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:46.364397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1801c3a-518d-44e5-a15b-4a4d076bbfb0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.376483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1801c3a-518d-44e5-a15b-4a4d076bbfb0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.382401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.382835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.383107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.383422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.384197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.386698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.421753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234f45ef04ee4076a33df409209a9602', 'request_id': 'req-3881f27c-f899-464b-b41b-04ebb144bcfe'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:46.425893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1113/2223] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:46.430159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.433654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234f45ef04ee4076a33df409209a9602', 'request_id': 'req-3881f27c-f899-464b-b41b-04ebb144bcfe'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:46.440853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234f45ef04ee4076a33df409209a9602', 'request_id': 'req-3881f27c-f899-464b-b41b-04ebb144bcfe'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:46.455811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] The token cache is being invalidate because project 234f45ef04ee4076a33df409209a9602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:46.456158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:46.456842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3881f27c-f899-464b-b41b-04ebb144bcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:46.458488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1111/2224] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:46 2022] DELETE /identity/v3/projects/234f45ef04ee4076a33df409209a9602 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:46.464429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c43dc-b083-4619-befa-94ae8871e881 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.464792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c43dc-b083-4619-befa-94ae8871e881 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.465131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c43dc-b083-4619-befa-94ae8871e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.480124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:46.505358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8c9c43dc-b083-4619-befa-94ae8871e881 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:46.508753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8c9c43dc-b083-4619-befa-94ae8871e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:46.509150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a014-9d76-4cb4-b625-ec1e774a2fb4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.516762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.517095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.517444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.517784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.518493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.520637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.530151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1112/2225] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:46.539227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fedf-c9e9-49ac-92df-1788f7c1e8cc None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.539544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fedf-c9e9-49ac-92df-1788f7c1e8cc None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.539819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fedf-c9e9-49ac-92df-1788f7c1e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.547146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1114/2226] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:46.550649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.552617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:46.563744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6e59fedf-c9e9-49ac-92df-1788f7c1e8cc None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:46.565045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6e59fedf-c9e9-49ac-92df-1788f7c1e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:46.572016 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3346-893f-46ea-a28d-acf1b184866f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.578387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.579081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.579367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.582616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.582616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.582616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.583758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1113/2227] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:46.588008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59fedf-c9e9-49ac-92df-1788f7c1e8cc None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.593766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1115/2228] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:46.597711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.604127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59fedf-c9e9-49ac-92df-1788f7c1e8cc None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.610434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.610973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.611300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.611427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd2860-f512-4400-af18-5b189bd53b19 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.611595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.612299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:46.612992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.615028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.618872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.619928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.620276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.620625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] PATH_INFO: `/v3/projects/6f91dbee9b164b54b3c534397b248151/users/16f8e158f3504f1985163930e903620f/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.635756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1114/2229] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:23:46.637776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.640537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f91dbee9b164b54b3c534397b248151, user_id=16f8e158f3504f1985163930e903620f, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.644204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.651277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e7587-210d-4f26-88a3-b0f1784ba89c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.660309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.660920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.661193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.661529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.662102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.664664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.665855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1116/2230] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:46 2022] PUT /identity/v3/projects/6f91dbee9b164b54b3c534397b248151/users/16f8e158f3504f1985163930e903620f/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:46.670573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.676614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:46.711426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1115/2231] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:46.714537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.782427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652ccb2-b642-4d7e-9405-8fc73f04cf03 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.835250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55b377-0ff1-42ff-850f-9c504757b5c1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.846586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.847972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.848510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.848510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.849176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.851686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.862840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.864359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.864971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.865391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.866215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.868912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.877724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1116/2232] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:46.880349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1117/2233] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:46.881732 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.884574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.895612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d74dab-fefd-4301-b43c-fab70b303c1a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.897072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0c9da-e2f8-4f08-8f15-5507ee0729ed admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.900801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13805621-ca0f-4b9b-b282-75386fcaffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.901466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13805621-ca0f-4b9b-b282-75386fcaffdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.901742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13805621-ca0f-4b9b-b282-75386fcaffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.902005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13805621-ca0f-4b9b-b282-75386fcaffdd admin admin] PATH_INFO: `/v3/projects/6f91dbee9b164b54b3c534397b248151/users/16f8e158f3504f1985163930e903620f/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.904339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:46.904832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13805621-ca0f-4b9b-b282-75386fcaffdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f91dbee9b164b54b3c534397b248151, user_id=16f8e158f3504f1985163930e903620f, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.905465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.905937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.906402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.907196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:46.907683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13805621-ca0f-4b9b-b282-75386fcaffdd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.909311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:46.925087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1117/2234] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:46.928679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1118/2235] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:46 2022] PUT /identity/v3/projects/6f91dbee9b164b54b3c534397b248151/users/16f8e158f3504f1985163930e903620f/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:46.931801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:46.939767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:46.940169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:46.941149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:46.957984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3d3c4-e757-445b-be9f-5f8cf83e86d5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:46.980014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] MFA Rules not processed for user `16f8e158f3504f1985163930e903620f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:46.981264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:47.011507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:47.050325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:47.051421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:47.051704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:47.051973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:47.052619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:47.054242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:47.065025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1118/2236] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:47.069097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:47.079705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09417551-6d1e-47b5-9446-c27d1b59c1fc admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:47.084573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dcacc-6cc8-4a14-b348-f3e9bf591bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:47.085222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dcacc-6cc8-4a14-b348-f3e9bf591bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:47.086017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dcacc-6cc8-4a14-b348-f3e9bf591bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:47.086311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dcacc-6cc8-4a14-b348-f3e9bf591bd4 admin admin] PATH_INFO: `/v3/projects/5bfde9d2238e4374bd4b3ac696e0e97a/users/8009fcd263604bd9af2fafcb1d48db65/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:47.088168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1119/2237] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:47.103161 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:47.103427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dcacc-6cc8-4a14-b348-f3e9bf591bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfde9d2238e4374bd4b3ac696e0e97a, user_id=8009fcd263604bd9af2fafcb1d48db65, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:47.104696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:47.106443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dcacc-6cc8-4a14-b348-f3e9bf591bd4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:47.124930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1119/2238] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:47 2022] PUT /identity/v3/projects/5bfde9d2238e4374bd4b3ac696e0e97a/users/8009fcd263604bd9af2fafcb1d48db65/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:47.135153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:47.135587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:47.135865 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:47.165269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] MFA Rules not processed for user `8009fcd263604bd9af2fafcb1d48db65`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:47.166476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:47.167923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361ff0-112f-4c18-b41d-290fa3691198 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:47.197224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:47.225144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554739b2-e6cd-4683-b151-9d7117d78056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:47.225773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554739b2-e6cd-4683-b151-9d7117d78056 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:47.226691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554739b2-e6cd-4683-b151-9d7117d78056 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:47.227185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554739b2-e6cd-4683-b151-9d7117d78056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:47.229876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-554739b2-e6cd-4683-b151-9d7117d78056 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:47.245672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1120/2239] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:47.256244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:47.258312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:47.270706 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a92f50-08ed-4729-ae67-067f166a97b8 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:47.274478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:47.275103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:47.275391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:47.275664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:47.284973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:47.286440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:47.296917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1121/2240] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:47.300823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554739b2-e6cd-4683-b151-9d7117d78056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:47.303044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554739b2-e6cd-4683-b151-9d7117d78056 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:47.314657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1120/2241] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:47.819810 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:47.822359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:47.899098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1fd1-480f-4a4e-995f-a9ca9e2237c4 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:47.906385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:47.907175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:47.907490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:47.907751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] PATH_INFO: `/v3/users/36d2cb4a9fd44d6a9646a3539139ff38` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:47.908913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d2cb4a9fd44d6a9646a3539139ff38)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:47.910845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:47.960047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d2cb4a9fd44d6a9646a3539139ff38'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.016408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d2cb4a9fd44d6a9646a3539139ff38'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.032723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d2cb4a9fd44d6a9646a3539139ff38'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.033477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d2cb4a9fd44d6a9646a3539139ff38'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.034103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d2cb4a9fd44d6a9646a3539139ff38'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.051464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1122/2242] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:47 2022] DELETE /identity/v3/users/36d2cb4a9fd44d6a9646a3539139ff38 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:48.056603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.057087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.057330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.079908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:48.081195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:48.094935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:48.149189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1121/2243] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:48.163310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:48.166123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:48.210035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:48.229717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670e30-6e71-47a4-a1ba-7040c92a9ab7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:48.233329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016088d-4746-4830-8773-5a565241a667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:48.233927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016088d-4746-4830-8773-5a565241a667 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.234205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016088d-4746-4830-8773-5a565241a667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.234475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016088d-4746-4830-8773-5a565241a667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.247135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016088d-4746-4830-8773-5a565241a667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:48.248595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016088d-4746-4830-8773-5a565241a667 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:48.257978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1123/2244] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:48.537189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:48.538683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:48.553441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e3381-3c6b-4565-80a3-d854ef45b40d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:48.559877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:48.561131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.561795 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.562589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] PATH_INFO: `/v3/projects/b897c811e0e24357b3e467f46a443463` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.565534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b897c811e0e24357b3e467f46a443463)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:48.566459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:48.622339 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b897c811e0e24357b3e467f46a443463', 'request_id': 'req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.630471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b897c811e0e24357b3e467f46a443463', 'request_id': 'req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.636565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b897c811e0e24357b3e467f46a443463', 'request_id': 'req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.647323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] The token cache is being invalidate because project b897c811e0e24357b3e467f46a443463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:48.647637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.648807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:48.650292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1122/2245] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:48 2022] DELETE /identity/v3/projects/b897c811e0e24357b3e467f46a443463 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:48.655312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b21a6-d87d-4f86-add5-f51215ad520b None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.655577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b21a6-d87d-4f86-add5-f51215ad520b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.655850 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b21a6-d87d-4f86-add5-f51215ad520b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.675019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-226b21a6-d87d-4f86-add5-f51215ad520b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:48.676252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-226b21a6-d87d-4f86-add5-f51215ad520b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:48.742122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1124/2246] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:48.748523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:48.749438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ae08-1493-44c2-b73e-8f7ff88f69a3 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.749851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ae08-1493-44c2-b73e-8f7ff88f69a3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.750132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:48.750243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ae08-1493-44c2-b73e-8f7ff88f69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.770243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-71f4ae08-1493-44c2-b73e-8f7ff88f69a3 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:48.771474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-71f4ae08-1493-44c2-b73e-8f7ff88f69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:48.779992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1125/2247] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:48.784812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ae08-1493-44c2-b73e-8f7ff88f69a3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:48.796452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ae08-1493-44c2-b73e-8f7ff88f69a3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:48.801457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:48.802051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.802329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.802597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.803237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:48.803569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:48.805205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:48.811871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24e307-83ce-4e27-ac80-9cd126f3eb1d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:48.815639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:48.816712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.817015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.817275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.818097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1126/2248] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:23:48.819132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:48.822875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:48.834019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36d24-02f2-41f1-b2b9-29bcb2d5bb01 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:48.839727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:48.840313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.840592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.840863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.841493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:48.843461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:48.876754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1127/2249] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:48 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:48.880566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:48.894994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:48.900447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:48.903367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:48.919567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1123/2250] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:48.964205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead332f3-7c58-4850-a71e-d026dccd52c1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:48.970169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:48.970790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:48.971071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:48.971400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:48.972049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:48.975825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:49.021945 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1128/2251] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:48 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:49.025852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:49.037390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea14cd-c3b3-43fa-afd6-b86e78c3b400 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:49.043987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:49.044603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:49.044935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:49.045207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:49.045914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:49.048129 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:49.061020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1124/2252] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:49.064661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:49.077691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c846f1-1635-436c-ad29-e7a956b45d15 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:49.085630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f109831-04b7-49c3-9f1d-b5677dd9a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:49.086476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f109831-04b7-49c3-9f1d-b5677dd9a3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:49.086835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f109831-04b7-49c3-9f1d-b5677dd9a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:49.087180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f109831-04b7-49c3-9f1d-b5677dd9a3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:49.087955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f109831-04b7-49c3-9f1d-b5677dd9a3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:49.089929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f109831-04b7-49c3-9f1d-b5677dd9a3a6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:49.105218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1129/2253] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:49.109807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:49.146536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe3710-31b1-438f-a527-d730bac1044f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:49.153822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:49.155158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:49.155757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:49.157589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] PATH_INFO: `/v3/projects/8687d9d1cc4146ad866cb0cb008fe1fc/users/6ada87d9da454c4db6047b7694e68371/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:49.191825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8687d9d1cc4146ad866cb0cb008fe1fc, user_id=6ada87d9da454c4db6047b7694e68371, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:49.195747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:49.223811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1125/2254] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:49 2022] PUT /identity/v3/projects/8687d9d1cc4146ad866cb0cb008fe1fc/users/6ada87d9da454c4db6047b7694e68371/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:49.233476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:49.233779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:49.234252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:49.277611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] MFA Rules not processed for user `6ada87d9da454c4db6047b7694e68371`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:49.280607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:49.286964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:49.407458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1130/2255] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:49.421719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:49.424752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:49.491625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791bd6-b020-4c05-b896-25bcdfdc1767 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:49.495866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690b152-0951-4e7b-b542-b80e0e3d754b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:49.496690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b152-0951-4e7b-b542-b80e0e3d754b service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:49.497039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b152-0951-4e7b-b542-b80e0e3d754b service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:49.497399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b152-0951-4e7b-b542-b80e0e3d754b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:49.506033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690b152-0951-4e7b-b542-b80e0e3d754b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:49.507686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690b152-0951-4e7b-b542-b80e0e3d754b service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:49.517561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1126/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:52.827217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:52.828744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:52.901736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e33e7c-ce82-4acb-bba9-934e312be28b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:52.906963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:52.910851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:52.911256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:52.913103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] PATH_INFO: `/v3/users/2311c91a48a84db2adb59ddbce07128a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:52.914509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2311c91a48a84db2adb59ddbce07128a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:52.916597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:52.969358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2311c91a48a84db2adb59ddbce07128a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:52.977256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2311c91a48a84db2adb59ddbce07128a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.000304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2311c91a48a84db2adb59ddbce07128a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.000304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2311c91a48a84db2adb59ddbce07128a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.000847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2311c91a48a84db2adb59ddbce07128a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.021330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1131/2257] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:52 2022] DELETE /identity/v3/users/2311c91a48a84db2adb59ddbce07128a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:53.026181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:53.026688 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:53.026781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:53.047327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:53.048665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:53.119432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1127/2258] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:53.130593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:53.132169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:53.174296 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:53.207913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0c589-c88e-48e5-8eb2-3d450942290c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:53.211633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:53.212247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:53.212532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:53.212805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:53.221920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:53.223479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:53.234570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1132/2259] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:53.524722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:53.529181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:53.546901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713bfc-1fea-4e3e-b4f9-2fbfce0e009b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:53.551774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:53.552416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:53.552692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:53.552964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] PATH_INFO: `/v3/projects/2a59998785524377b3ce0f3aa6b9ef85` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:53.555270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a59998785524377b3ce0f3aa6b9ef85)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:53.557260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:53.615288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a59998785524377b3ce0f3aa6b9ef85', 'request_id': 'req-d4df11a8-2f83-4b8a-aa15-c12782293b0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.626637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a59998785524377b3ce0f3aa6b9ef85', 'request_id': 'req-d4df11a8-2f83-4b8a-aa15-c12782293b0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.628879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:53.639501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a59998785524377b3ce0f3aa6b9ef85', 'request_id': 'req-d4df11a8-2f83-4b8a-aa15-c12782293b0a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.653410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] The token cache is being invalidate because project 2a59998785524377b3ce0f3aa6b9ef85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:53.653798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.654625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.656721 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1128/2260] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:53 2022] DELETE /identity/v3/projects/2a59998785524377b3ce0f3aa6b9ef85 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:53.660688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:53.673647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fbdfa-6cfb-41b7-8926-2f94a614cad3 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:53.746698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:53.747635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:53.748019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:53.748936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] PATH_INFO: `/v3/users/16f8e158f3504f1985163930e903620f` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:53.749736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f8e158f3504f1985163930e903620f)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:53.751938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:53.820574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f8e158f3504f1985163930e903620f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.831785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f8e158f3504f1985163930e903620f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.860619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f8e158f3504f1985163930e903620f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.862058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f8e158f3504f1985163930e903620f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.863047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-2a559363-8b88-4731-95dc-c4e0d50aac14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f8e158f3504f1985163930e903620f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:53.887832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1133/2261] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:53 2022] DELETE /identity/v3/users/16f8e158f3504f1985163930e903620f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:54.404836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:54.406344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:54.426788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df11a8-2f83-4b8a-aa15-c12782293b0a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:54.505602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:54.506240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:54.506517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:54.507352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] PATH_INFO: `/v3/projects/6f91dbee9b164b54b3c534397b248151` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:54.508814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f91dbee9b164b54b3c534397b248151)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:54.510855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:54.593114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f91dbee9b164b54b3c534397b248151', 'request_id': 'req-1e8fd31b-7d55-425a-9746-fc47c0b930ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:54.602773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f91dbee9b164b54b3c534397b248151', 'request_id': 'req-1e8fd31b-7d55-425a-9746-fc47c0b930ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:54.614046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f91dbee9b164b54b3c534397b248151', 'request_id': 'req-1e8fd31b-7d55-425a-9746-fc47c0b930ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:54.632585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] The token cache is being invalidate because project 6f91dbee9b164b54b3c534397b248151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:54.633024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:54.633928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e8fd31b-7d55-425a-9746-fc47c0b930ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:54.639616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1129/2262] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:54 2022] DELETE /identity/v3/projects/6f91dbee9b164b54b3c534397b248151 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:54.641657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586099-6387-4945-bd1f-4b145f26aaa6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:54.645783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586099-6387-4945-bd1f-4b145f26aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:54.646165 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586099-6387-4945-bd1f-4b145f26aaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:54.684195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6c586099-6387-4945-bd1f-4b145f26aaa6 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:54.694063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6c586099-6387-4945-bd1f-4b145f26aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:54.752297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:54.779423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1134/2263] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:54.785362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae8a1-f5d1-4735-9038-22905c46acac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:54.785866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae8a1-f5d1-4735-9038-22905c46acac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:54.786123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae8a1-f5d1-4735-9038-22905c46acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:54.817919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-278ae8a1-f5d1-4735-9038-22905c46acac None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:54.819712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-278ae8a1-f5d1-4735-9038-22905c46acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:54.828427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1130/2264] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:54.832826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586099-6387-4945-bd1f-4b145f26aaa6 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:54.843827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586099-6387-4945-bd1f-4b145f26aaa6 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:54.848912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:54.849514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:54.849871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:54.850147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:54.850890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:54.851194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:54.852854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:54.864855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1135/2265] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:23:54.869432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae8a1-f5d1-4735-9038-22905c46acac None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:54.878638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae8a1-f5d1-4735-9038-22905c46acac None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:54.883859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:54.884498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:54.884773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:54.885037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:54.885678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:54.887603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:54.914704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1131/2266] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:54 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:54.918947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:54.929839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6149d5-7d6b-4ec9-b68f-a22114d6fda4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:54.987670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:54.988480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:54.988614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:54.988797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:54.989428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:54.991671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.012463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1136/2267] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:54 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:55.016574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.028421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098436b-bec6-467f-aea2-dd8b40511419 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.033149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.033775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.034047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.034315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.034955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.036589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.046845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1132/2268] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:55.050927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.061441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95937e4-4e9e-4f2b-b826-2e9e45f09c73 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.066021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce800-e6a8-4a46-98cb-7573f9a4fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.066593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce800-e6a8-4a46-98cb-7573f9a4fa02 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.066871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce800-e6a8-4a46-98cb-7573f9a4fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.067144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce800-e6a8-4a46-98cb-7573f9a4fa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.067825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce800-e6a8-4a46-98cb-7573f9a4fa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.069985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce800-e6a8-4a46-98cb-7573f9a4fa02 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.080424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1137/2269] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:55.084307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.094183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aa264-e552-44ee-821e-7c9b8eee4a64 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.098942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.099632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.099912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.100184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] PATH_INFO: `/v3/projects/06db3624a0894b6e9f3554fad97d9fce/users/6138f47fc1424aed953b14b1ce1f86e8/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.115541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06db3624a0894b6e9f3554fad97d9fce, user_id=6138f47fc1424aed953b14b1ce1f86e8, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.118869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.131413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1133/2270] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:55 2022] PUT /identity/v3/projects/06db3624a0894b6e9f3554fad97d9fce/users/6138f47fc1424aed953b14b1ce1f86e8/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:55.143558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530e049-a357-491e-b0ab-464f7d63161c None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.143839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530e049-a357-491e-b0ab-464f7d63161c None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.144107 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530e049-a357-491e-b0ab-464f7d63161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.171979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c530e049-a357-491e-b0ab-464f7d63161c None None] MFA Rules not processed for user `6138f47fc1424aed953b14b1ce1f86e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:55.173274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c530e049-a357-491e-b0ab-464f7d63161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:55.243995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1138/2271] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:55.248629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.263358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:55.331905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce74e55-5a15-4c8c-ae45-083250a2479d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.337467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.338120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.338405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.339235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.339360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.341311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.373595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1134/2272] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:55 2022] POST /identity/v3/projects => generated 407 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:55.378353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530e049-a357-491e-b0ab-464f7d63161c None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.390886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530e049-a357-491e-b0ab-464f7d63161c None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.433854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:55.454896 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.455684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.456032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.456379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.457088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.459103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.484523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1139/2273] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:55 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:55.488697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.501353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5f808-d21b-4358-a8bc-1a72031f044e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.506469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.507092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.507380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.507669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.508328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.509969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.520871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1135/2274] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:55.525540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.538894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410558-f555-4b55-88ff-cc0f77e43b9e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.543986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.544782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.545130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.545472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] PATH_INFO: `/v3/projects/699606f5d5264b44bb407a2236c62433/users/c1e2c1754f4149efb62ce6597b0ddadb/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.561871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699606f5d5264b44bb407a2236c62433, user_id=c1e2c1754f4149efb62ce6597b0ddadb, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.564687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.578244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1140/2275] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:55 2022] PUT /identity/v3/projects/699606f5d5264b44bb407a2236c62433/users/c1e2c1754f4149efb62ce6597b0ddadb/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:55.582409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.592363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66050d0-8612-48ec-ba08-125f5046dd60 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.651534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35d61a-3e68-456b-8462-a5fe60e466c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.652048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d61a-3e68-456b-8462-a5fe60e466c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.652329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d61a-3e68-456b-8462-a5fe60e466c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.652603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d61a-3e68-456b-8462-a5fe60e466c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.653248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35d61a-3e68-456b-8462-a5fe60e466c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.654890 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35d61a-3e68-456b-8462-a5fe60e466c6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.665661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1136/2276] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:23:55.669730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.679833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d77730-2a98-470b-b454-cbe17938b251 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.684345 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.684978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.685248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.685510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] PATH_INFO: `/v3/projects/699606f5d5264b44bb407a2236c62433/users/c1e2c1754f4149efb62ce6597b0ddadb/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.687398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699606f5d5264b44bb407a2236c62433, user_id=c1e2c1754f4149efb62ce6597b0ddadb, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.690044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.700777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1141/2277] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:55 2022] PUT /identity/v3/projects/699606f5d5264b44bb407a2236c62433/users/c1e2c1754f4149efb62ce6597b0ddadb/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:55.711555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df6faf-4564-45d5-a5dc-8bd65886e5f5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.711849 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df6faf-4564-45d5-a5dc-8bd65886e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.712127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df6faf-4564-45d5-a5dc-8bd65886e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.741683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-94df6faf-4564-45d5-a5dc-8bd65886e5f5 None None] MFA Rules not processed for user `c1e2c1754f4149efb62ce6597b0ddadb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:55.742970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-94df6faf-4564-45d5-a5dc-8bd65886e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:55.816118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1137/2278] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:55.826782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:55.830953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:55.902437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85969839-14ef-400d-a5ee-d959f33aadc6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:55.907591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:55.908435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:55.909068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:55.909068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:55.921001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:55.925106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:55.938175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1142/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:55 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:56.117226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df6faf-4564-45d5-a5dc-8bd65886e5f5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:56.127551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df6faf-4564-45d5-a5dc-8bd65886e5f5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:56.131181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a39bab-9928-428c-a122-320c05ded2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:56.132342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a39bab-9928-428c-a122-320c05ded2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:56.132644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a39bab-9928-428c-a122-320c05ded2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:56.132864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a39bab-9928-428c-a122-320c05ded2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:56.137426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:56.199662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a39bab-9928-428c-a122-320c05ded2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:56.201108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a39bab-9928-428c-a122-320c05ded2c3 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:56.210649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1138/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:56 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:23:58.112878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:58.114291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:58.182036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4151df-dfae-420b-b239-847dc1026124 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:58.187093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:58.187934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:58.188309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:58.188718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] PATH_INFO: `/v3/users/8009fcd263604bd9af2fafcb1d48db65` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:58.189932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8009fcd263604bd9af2fafcb1d48db65)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:58.191966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:58.235331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:58.243104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8009fcd263604bd9af2fafcb1d48db65'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.251305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8009fcd263604bd9af2fafcb1d48db65'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.265417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8009fcd263604bd9af2fafcb1d48db65'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.266147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8009fcd263604bd9af2fafcb1d48db65'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.266819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8009fcd263604bd9af2fafcb1d48db65'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.279599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1143/2281] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:23:58 2022] DELETE /identity/v3/users/8009fcd263604bd9af2fafcb1d48db65 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:58.284720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:58.285284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:58.285284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:58.308021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:58.309253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:58.372432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1139/2282] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:23:58.382639 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:58.384275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:58.443171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f3d28-05b4-4310-bc77-5cc5093d5f11 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:58.447320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b12d8-87d6-4553-bb1d-4c6844e630c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:58.447958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b12d8-87d6-4553-bb1d-4c6844e630c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:58.448234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b12d8-87d6-4553-bb1d-4c6844e630c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:58.448503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b12d8-87d6-4553-bb1d-4c6844e630c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:58.457935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b12d8-87d6-4553-bb1d-4c6844e630c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:58.460310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b12d8-87d6-4553-bb1d-4c6844e630c5 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:58.472120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1144/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:23:58.753535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:58.754937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:58.767024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed02b4-020f-43eb-af35-4106b0dc6d36 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:58.771677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:58.772872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:58.773204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:58.773532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] PATH_INFO: `/v3/projects/5bfde9d2238e4374bd4b3ac696e0e97a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:58.774776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfde9d2238e4374bd4b3ac696e0e97a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:58.777159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:58.837634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfde9d2238e4374bd4b3ac696e0e97a', 'request_id': 'req-f7d0660a-12d8-4641-8f71-3ad328d872f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.847477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfde9d2238e4374bd4b3ac696e0e97a', 'request_id': 'req-f7d0660a-12d8-4641-8f71-3ad328d872f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.854241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfde9d2238e4374bd4b3ac696e0e97a', 'request_id': 'req-f7d0660a-12d8-4641-8f71-3ad328d872f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.866449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] The token cache is being invalidate because project 5bfde9d2238e4374bd4b3ac696e0e97a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:23:58.866741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.867411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7d0660a-12d8-4641-8f71-3ad328d872f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:23:58.869113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1140/2284] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:23:58 2022] DELETE /identity/v3/projects/5bfde9d2238e4374bd4b3ac696e0e97a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:23:58.874229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a7c6-5027-4d3b-a6fd-bea2faae6be9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:58.874512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a7c6-5027-4d3b-a6fd-bea2faae6be9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:58.874783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a7c6-5027-4d3b-a6fd-bea2faae6be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:58.900765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-d979a7c6-5027-4d3b-a6fd-bea2faae6be9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:58.902163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d979a7c6-5027-4d3b-a6fd-bea2faae6be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:59.005220 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1145/2285] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:59.014042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e346d-467c-465c-8053-5808accfa789 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.014767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e346d-467c-465c-8053-5808accfa789 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.015066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e346d-467c-465c-8053-5808accfa789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.041550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-173e346d-467c-465c-8053-5808accfa789 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:59.043036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-173e346d-467c-465c-8053-5808accfa789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:59.066644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1141/2286] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:59.067401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979a7c6-5027-4d3b-a6fd-bea2faae6be9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:59.080032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979a7c6-5027-4d3b-a6fd-bea2faae6be9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:59.085478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:59.086398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.086831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.087265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.087970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:23:59.088281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:59.089922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:59.102985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1146/2287] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:23:59.107576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e346d-467c-465c-8053-5808accfa789 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:59.117584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e346d-467c-465c-8053-5808accfa789 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:59.125758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:59.135816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.136261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.136566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.137232 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:59.139194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:59.165979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:59.174285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1142/2288] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:23:59 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:23:59.178613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:59.191224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b219e-585a-48cb-952f-4da442ce5af8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:59.248068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:23:59.264870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:59.265471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.265752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.266021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.266653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:59.268652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:59.298819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1147/2289] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:23:59 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:23:59.300056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:59.311153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07065e-e8fc-4440-afcb-e833bcf6a0de admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:59.316243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:59.316859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.317135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.317403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.318059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:59.320417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:59.332361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1143/2290] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:59.336923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:59.347427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec28c65-f25a-44b8-b611-a41091583a1b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:59.352176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525788-f71c-46ce-865a-5def9920b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:59.352770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525788-f71c-46ce-865a-5def9920b24c admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.353051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525788-f71c-46ce-865a-5def9920b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.353326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525788-f71c-46ce-865a-5def9920b24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.353970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11525788-f71c-46ce-865a-5def9920b24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:59.355619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11525788-f71c-46ce-865a-5def9920b24c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:59.366362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1148/2291] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:23:59.370352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:59.380421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8737a-ef51-4a8d-8cca-dc0c96de9e60 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:59.386412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:59.387159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.387469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.387981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] PATH_INFO: `/v3/projects/616dd8caeaa545c7968b714ec4bf14e2/users/e576df45bde048aea99a010e5f3919e7/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.405236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=616dd8caeaa545c7968b714ec4bf14e2, user_id=e576df45bde048aea99a010e5f3919e7, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:59.407969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:59.420798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1144/2292] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:23:59 2022] PUT /identity/v3/projects/616dd8caeaa545c7968b714ec4bf14e2/users/e576df45bde048aea99a010e5f3919e7/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:23:59.425921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.426208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.426503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.447387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:23:59.448616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:59.513031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1149/2293] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:23:59.527843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:23:59.529784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:23:59.720578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335b905-3259-4d74-bff7-523d000f1a5a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:23:59.724296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495e7bc-2435-45f3-bd93-01ab592c630a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:23:59.725064 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e7bc-2435-45f3-bd93-01ab592c630a service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:23:59.725337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e7bc-2435-45f3-bd93-01ab592c630a service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:23:59.725606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e7bc-2435-45f3-bd93-01ab592c630a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:23:59.734791 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495e7bc-2435-45f3-bd93-01ab592c630a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:23:59.736237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495e7bc-2435-45f3-bd93-01ab592c630a service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:23:59.746397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1145/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:24:01.780654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:01.783963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:01.802704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147bd5d-e6ab-44e0-b9c4-95340eae9911 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:01.809955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:01.810961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:01.811525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:01.812379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] PATH_INFO: `/v3/users/6138f47fc1424aed953b14b1ce1f86e8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:01.813710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6138f47fc1424aed953b14b1ce1f86e8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:01.815879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:01.878285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6138f47fc1424aed953b14b1ce1f86e8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:01.891437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6138f47fc1424aed953b14b1ce1f86e8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:01.912697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6138f47fc1424aed953b14b1ce1f86e8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:01.917030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6138f47fc1424aed953b14b1ce1f86e8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:01.918050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6138f47fc1424aed953b14b1ce1f86e8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:01.942257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1150/2295] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:24:01 2022] DELETE /identity/v3/users/6138f47fc1424aed953b14b1ce1f86e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:01.944388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:01.946180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:01.946757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:01.970126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:01.971392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:02.047617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1146/2296] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:24:02.057864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:02.062013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:02.112111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:02.134214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71b1c9-f392-4098-88fb-81c7e535c4b2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:02.138146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:02.138768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:02.139047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:02.139318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:02.150631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:02.152179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:02.177091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1151/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:24:03.218631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:03.221217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:03.244166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a83f37-a655-4635-9146-ff4501763b4d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:03.258742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:03.259535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:03.259883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:03.260235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] PATH_INFO: `/v3/projects/06db3624a0894b6e9f3554fad97d9fce` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:03.262401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06db3624a0894b6e9f3554fad97d9fce)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:03.265087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:03.346489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06db3624a0894b6e9f3554fad97d9fce', 'request_id': 'req-63a67d0b-1882-417f-abd8-ce14c8686a93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.356480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06db3624a0894b6e9f3554fad97d9fce', 'request_id': 'req-63a67d0b-1882-417f-abd8-ce14c8686a93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.364664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:03.370722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06db3624a0894b6e9f3554fad97d9fce', 'request_id': 'req-63a67d0b-1882-417f-abd8-ce14c8686a93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.407701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] The token cache is being invalidate because project 06db3624a0894b6e9f3554fad97d9fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:24:03.408024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.408666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.416322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1147/2298] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:24:03 2022] DELETE /identity/v3/projects/06db3624a0894b6e9f3554fad97d9fce => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:03.417909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:03.432061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c419e6-147d-404c-9561-3d3fcf353ba6 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:03.565623 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:03.566290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:03.566574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:03.566849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] PATH_INFO: `/v3/users/c1e2c1754f4149efb62ce6597b0ddadb` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:03.569694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e2c1754f4149efb62ce6597b0ddadb)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:03.571734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:03.661600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e2c1754f4149efb62ce6597b0ddadb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.672243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e2c1754f4149efb62ce6597b0ddadb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.706400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e2c1754f4149efb62ce6597b0ddadb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.707445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e2c1754f4149efb62ce6597b0ddadb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.711473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-55b9a958-0a42-4dbf-812e-e5cf7f08a6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e2c1754f4149efb62ce6597b0ddadb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:03.751018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1152/2299] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:24:03 2022] DELETE /identity/v3/users/c1e2c1754f4149efb62ce6597b0ddadb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:04.281784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:04.283568 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:04.305691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67d0b-1882-417f-abd8-ce14c8686a93 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:04.391207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:04.392528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:04.393108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:04.393592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] PATH_INFO: `/v3/projects/699606f5d5264b44bb407a2236c62433` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:04.395238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=699606f5d5264b44bb407a2236c62433)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:04.399104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:04.468576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699606f5d5264b44bb407a2236c62433', 'request_id': 'req-0ffa47aa-b032-4c3b-830b-4901341521cb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:04.478569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699606f5d5264b44bb407a2236c62433', 'request_id': 'req-0ffa47aa-b032-4c3b-830b-4901341521cb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:04.485802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699606f5d5264b44bb407a2236c62433', 'request_id': 'req-0ffa47aa-b032-4c3b-830b-4901341521cb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:04.500388 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] The token cache is being invalidate because project 699606f5d5264b44bb407a2236c62433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:24:04.500687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:04.501359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ffa47aa-b032-4c3b-830b-4901341521cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:04.503272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1148/2300] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:24:04 2022] DELETE /identity/v3/projects/699606f5d5264b44bb407a2236c62433 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:04.512692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834e877-ab2f-4058-9fdf-d2f6241460b4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:04.512692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834e877-ab2f-4058-9fdf-d2f6241460b4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:04.513331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834e877-ab2f-4058-9fdf-d2f6241460b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:04.536018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c834e877-ab2f-4058-9fdf-d2f6241460b4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:04.537545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c834e877-ab2f-4058-9fdf-d2f6241460b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:04.619069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:04.653718 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1153/2301] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:04.663272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abf08-e838-43da-ab73-baab9562bd22 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:04.663761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abf08-e838-43da-ab73-baab9562bd22 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:04.664305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abf08-e838-43da-ab73-baab9562bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:04.692284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b32abf08-e838-43da-ab73-baab9562bd22 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:04.694612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b32abf08-e838-43da-ab73-baab9562bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:04.705405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1149/2302] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:04.709985 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834e877-ab2f-4058-9fdf-d2f6241460b4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:04.724122 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834e877-ab2f-4058-9fdf-d2f6241460b4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:04.730232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:04.730868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:04.731151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:04.731457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:04.732131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:24:04.732579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:04.734230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:04.752318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1154/2303] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:24:04.757103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abf08-e838-43da-ab73-baab9562bd22 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:04.766965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abf08-e838-43da-ab73-baab9562bd22 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:04.772140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106df67-f2b7-4d02-83fe-8f9b80fccf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:04.773039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106df67-f2b7-4d02-83fe-8f9b80fccf2b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:04.773401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106df67-f2b7-4d02-83fe-8f9b80fccf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:04.773768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106df67-f2b7-4d02-83fe-8f9b80fccf2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:04.774493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106df67-f2b7-4d02-83fe-8f9b80fccf2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:04.776562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106df67-f2b7-4d02-83fe-8f9b80fccf2b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:04.819356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1150/2304] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:24:04 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:24:04.823689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:04.836693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f704e79-7b2e-4514-a31d-9cf6705fe710 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:04.909885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:04.910620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:04.910620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:04.970958 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] MFA Rules not processed for user `e576df45bde048aea99a010e5f3919e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:04.972249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:04.974005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:04.974808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:04.975154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:04.975543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:04.976314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:04.978729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.022368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:05.027308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1155/2305] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:24:04 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:24:05.032978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.049183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8edb2-cb25-47fc-aabc-ce9ec8f1fd09 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.059104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.059781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.060062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.060409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.061118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.063042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.063651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1151/2306] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:24:05.064682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.066513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:05.079798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1156/2307] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:24:05.080937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.084365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddfb27-080e-4665-a574-e6ba679b5821 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.090001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.090626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.090902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.091167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.091584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc4dc-5b70-4801-a102-d21bff3a16b5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.091839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.093728 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.096770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.097577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.097996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.098269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.098947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.101159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.112249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1157/2308] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:24:05.117412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.124503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1152/2309] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:24:05 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:24:05.127875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.129075 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce119-bc12-45e0-aa59-d34b42c82a4b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.193947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb843e-9dbb-456b-a48b-9926466db3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.194304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb59ef-54ab-4158-a0a8-af55350e778c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.194613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb843e-9dbb-456b-a48b-9926466db3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.194934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb843e-9dbb-456b-a48b-9926466db3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.195156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb843e-9dbb-456b-a48b-9926466db3c2 admin admin] PATH_INFO: `/v3/projects/93cfadaa464749da9a50e86dcea09d0c/users/1b2775c37b7042a1a447c78076dfcd46/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.199411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.199742 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.200019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.200285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.200948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.202871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.217418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb843e-9dbb-456b-a48b-9926466db3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cfadaa464749da9a50e86dcea09d0c, user_id=1b2775c37b7042a1a447c78076dfcd46, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.220397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb843e-9dbb-456b-a48b-9926466db3c2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.229205 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1153/2310] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:24:05 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:24:05.231918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.242615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1158/2311] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:24:05 2022] PUT /identity/v3/projects/93cfadaa464749da9a50e86dcea09d0c/users/1b2775c37b7042a1a447c78076dfcd46/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:05.247478 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb933-e4ba-41d8-8f2f-bddcad67f02f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.247767 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb933-e4ba-41d8-8f2f-bddcad67f02f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.248163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb933-e4ba-41d8-8f2f-bddcad67f02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.254756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78219aad-4964-47f4-b1b4-27ca48faed58 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.270472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e2ecb933-e4ba-41d8-8f2f-bddcad67f02f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:05.271791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e2ecb933-e4ba-41d8-8f2f-bddcad67f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:05.310776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:05.341327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.341972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.342451 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.343653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.344320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.346052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.360608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1159/2312] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:05.370087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1154/2313] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:24:05.371299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.371559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb933-e4ba-41d8-8f2f-bddcad67f02f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.373089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:05.383554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb933-e4ba-41d8-8f2f-bddcad67f02f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.390617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2428-5e33-43cd-aad9-01915bd24a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.391403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2428-5e33-43cd-aad9-01915bd24a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.392040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2428-5e33-43cd-aad9-01915bd24a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.403573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2428-5e33-43cd-aad9-01915bd24a78 admin admin] PATH_INFO: `/v3/projects/2d56cb52a1e64faca63264cc90768da6/users/0d8af6a2c7894e41bd1843efd8f9cdf8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.452876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2428-5e33-43cd-aad9-01915bd24a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d56cb52a1e64faca63264cc90768da6, user_id=0d8af6a2c7894e41bd1843efd8f9cdf8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.456337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2428-5e33-43cd-aad9-01915bd24a78 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.493210 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1160/2314] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:24:05 2022] PUT /identity/v3/projects/2d56cb52a1e64faca63264cc90768da6/users/0d8af6a2c7894e41bd1843efd8f9cdf8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:05.495047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e690-88f7-4a01-8b90-03be1a9472df None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.495452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e690-88f7-4a01-8b90-03be1a9472df None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.496081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e690-88f7-4a01-8b90-03be1a9472df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.497899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:05.514297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766df011-5e83-4f71-9b56-8a8049af033d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.526121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-06a4e690-88f7-4a01-8b90-03be1a9472df None None] MFA Rules not processed for user `51af3e131caf4dd8b533816bb9abd4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:05.527452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-06a4e690-88f7-4a01-8b90-03be1a9472df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:05.613161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1161/2315] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:05.614407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4e690-88f7-4a01-8b90-03be1a9472df None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.652022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.652701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.652965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.653226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.745617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.748095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.764342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1155/2316] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:24:05.783003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4e690-88f7-4a01-8b90-03be1a9472df None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.787929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227139-69aa-4cfb-a333-ec379127d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.788757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227139-69aa-4cfb-a333-ec379127d960 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.789046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227139-69aa-4cfb-a333-ec379127d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.789320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227139-69aa-4cfb-a333-ec379127d960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.789980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227139-69aa-4cfb-a333-ec379127d960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.791821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227139-69aa-4cfb-a333-ec379127d960 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.804103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1162/2317] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:24:05.808222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:05.824582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac78f-12e5-4f25-97e5-97e53ca73a95 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:05.831725 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:05.832653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:05.832941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:05.833376 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] PATH_INFO: `/v3/projects/2d56cb52a1e64faca63264cc90768da6/users/0d8af6a2c7894e41bd1843efd8f9cdf8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:05.836300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d56cb52a1e64faca63264cc90768da6, user_id=0d8af6a2c7894e41bd1843efd8f9cdf8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:05.839154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:05.862690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1156/2318] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:24:05 2022] PUT /identity/v3/projects/2d56cb52a1e64faca63264cc90768da6/users/0d8af6a2c7894e41bd1843efd8f9cdf8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:07.062595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d90a-4945-408b-ab6c-4fe3e3596aa4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:07.063065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d90a-4945-408b-ab6c-4fe3e3596aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:07.063472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d90a-4945-408b-ab6c-4fe3e3596aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:07.116279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-bc00d90a-4945-408b-ab6c-4fe3e3596aa4 None None] MFA Rules not processed for user `1b2775c37b7042a1a447c78076dfcd46`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:07.117573 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-bc00d90a-4945-408b-ab6c-4fe3e3596aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:07.189216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:07.246206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1163/2319] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:07.252136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:07.355113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219300-2805-45a2-82c4-4bcbee6bd736 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:07.360526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:07.361428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:07.361880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:07.362370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:07.363443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:07.366017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:07.435265 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1157/2320] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:24:07 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:24:07.437141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00d90a-4945-408b-ab6c-4fe3e3596aa4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:07.461859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00d90a-4945-408b-ab6c-4fe3e3596aa4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:07.631734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:07.632909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:07.633729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:07.634319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:07.635485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:07.642357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:07.719587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1164/2321] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:24:07 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:24:07.723559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:07.743626 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20426b35-1696-4977-b896-106785a2b1d9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:07.751642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:07.752653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:07.753160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:07.753642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:07.754512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:07.757961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:07.776877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1158/2322] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:24:07.778119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:07.792787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5b91d-5435-4d44-a5f7-904023f34ca8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:07.812773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:07.814476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:07.814788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:07.815070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] PATH_INFO: `/v3/projects/b6a29384dcc345d798c2a07109c9f3e9/users/9110eb4ee2434d818617d0c7eb3b6ffa/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:07.851080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a29384dcc345d798c2a07109c9f3e9, user_id=9110eb4ee2434d818617d0c7eb3b6ffa, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:07.857550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:07.900031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1165/2323] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:24:07 2022] PUT /identity/v3/projects/b6a29384dcc345d798c2a07109c9f3e9/users/9110eb4ee2434d818617d0c7eb3b6ffa/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:24:07.907410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:07.921156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c35f-dd99-46b1-8d2c-56940c129524 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:07.936408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:08.001833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8c61c-a5a4-467b-b042-17c699800821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:08.002797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c61c-a5a4-467b-b042-17c699800821 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:08.002797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c61c-a5a4-467b-b042-17c699800821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:08.002989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c61c-a5a4-467b-b042-17c699800821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:08.003664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8c61c-a5a4-467b-b042-17c699800821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:08.005274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8c61c-a5a4-467b-b042-17c699800821 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:08.017074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1159/2324] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:24:08.021667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:08.033027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f426f-e639-438f-9a56-47f43a7581ce admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:08.038703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369465e1-c3e3-4e6c-a301-6fa0c285fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:08.039509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369465e1-c3e3-4e6c-a301-6fa0c285fd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:08.039788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369465e1-c3e3-4e6c-a301-6fa0c285fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:08.040060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369465e1-c3e3-4e6c-a301-6fa0c285fd6a admin admin] PATH_INFO: `/v3/projects/b6a29384dcc345d798c2a07109c9f3e9/users/9110eb4ee2434d818617d0c7eb3b6ffa/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:08.042135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369465e1-c3e3-4e6c-a301-6fa0c285fd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a29384dcc345d798c2a07109c9f3e9, user_id=9110eb4ee2434d818617d0c7eb3b6ffa, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:08.045532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369465e1-c3e3-4e6c-a301-6fa0c285fd6a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:08.066520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1166/2325] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:24:08 2022] PUT /identity/v3/projects/b6a29384dcc345d798c2a07109c9f3e9/users/9110eb4ee2434d818617d0c7eb3b6ffa/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:10.105396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:10.105978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:10.105978 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:10.165955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] MFA Rules not processed for user `9110eb4ee2434d818617d0c7eb3b6ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:10.167193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:10.287181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1160/2326] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:24:10.288562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7450cb-84f7-4cd6-993c-d6d69d1f7466 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:10.292195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7450cb-84f7-4cd6-993c-d6d69d1f7466 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:10.292667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7450cb-84f7-4cd6-993c-d6d69d1f7466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:10.313934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-fa7450cb-84f7-4cd6-993c-d6d69d1f7466 None None] MFA Rules not processed for user `1b2775c37b7042a1a447c78076dfcd46`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:10.315505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fa7450cb-84f7-4cd6-993c-d6d69d1f7466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:10.429959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1167/2327] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:10.441624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:10.443872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:10.597892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab7b05-2c32-4222-a120-b2244771a332 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:10.605655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:10.606545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:10.606975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:10.607463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:10.618912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:10.621507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:10.632198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1161/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:24:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:24:12.966665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301837-1b8f-46d5-9dd6-2b5855a70dbb None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:12.967162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301837-1b8f-46d5-9dd6-2b5855a70dbb None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:12.967621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301837-1b8f-46d5-9dd6-2b5855a70dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:13.008946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-dd301837-1b8f-46d5-9dd6-2b5855a70dbb None None] MFA Rules not processed for user `0d8af6a2c7894e41bd1843efd8f9cdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:13.010688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-dd301837-1b8f-46d5-9dd6-2b5855a70dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:13.047426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:13.091256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1168/2329] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:13.106222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:13.117505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1edb-1d2b-4895-a522-236f95873517 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:13.123085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:13.123744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:13.124023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:13.124292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:13.142116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:13.190907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:13.192737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:13.203259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1162/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:24:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:24:14.799819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595b08-0550-4da0-a57d-fc8270355f92 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:14.800421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595b08-0550-4da0-a57d-fc8270355f92 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:14.800421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595b08-0550-4da0-a57d-fc8270355f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:14.820017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-21595b08-0550-4da0-a57d-fc8270355f92 None None] MFA Rules not processed for user `e576df45bde048aea99a010e5f3919e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:14.821230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-21595b08-0550-4da0-a57d-fc8270355f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:14.828324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1169/2331] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:24:18.900800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:18.902325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:18.991188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68024c-f0bd-43dc-8b90-910f8be9ecaf service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:18.997068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:18.998186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:18.998693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:18.999043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] PATH_INFO: `/v3/users/6ada87d9da454c4db6047b7694e68371` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:19.000449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ada87d9da454c4db6047b7694e68371)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:19.002458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:19.077906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ada87d9da454c4db6047b7694e68371'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:19.090120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ada87d9da454c4db6047b7694e68371'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:19.110961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ada87d9da454c4db6047b7694e68371'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:19.111915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ada87d9da454c4db6047b7694e68371'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:19.112605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ada87d9da454c4db6047b7694e68371'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:19.130663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1163/2332] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:24:18 2022] DELETE /identity/v3/users/6ada87d9da454c4db6047b7694e68371 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:19.136778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:19.137385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:19.137614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:19.168069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:19.169736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:19.257287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1170/2333] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:19.269445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:19.271727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:19.330975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:19.398272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c22eb-ca10-408c-9c4e-2990a4651686 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:19.404045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5215103-fcd2-486e-8c71-e999d95cbd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:19.404743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5215103-fcd2-486e-8c71-e999d95cbd92 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:19.405026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5215103-fcd2-486e-8c71-e999d95cbd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:19.405301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5215103-fcd2-486e-8c71-e999d95cbd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:19.425501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5215103-fcd2-486e-8c71-e999d95cbd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:19.425501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5215103-fcd2-486e-8c71-e999d95cbd92 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:19.439729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1164/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:24:20.096238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:20.097681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:20.119630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe35306-ef03-49cb-a178-60a597f55287 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:20.128141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:20.128797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:20.129064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:20.129498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] PATH_INFO: `/v3/projects/8687d9d1cc4146ad866cb0cb008fe1fc` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:20.131311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8687d9d1cc4146ad866cb0cb008fe1fc)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:20.138440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:20.217218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8687d9d1cc4146ad866cb0cb008fe1fc', 'request_id': 'req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:20.230083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8687d9d1cc4146ad866cb0cb008fe1fc', 'request_id': 'req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:20.238255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8687d9d1cc4146ad866cb0cb008fe1fc', 'request_id': 'req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:20.252844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] The token cache is being invalidate because project 8687d9d1cc4146ad866cb0cb008fe1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:24:20.253141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:20.261106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:24:20.263052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1171/2335] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:24:20 2022] DELETE /identity/v3/projects/8687d9d1cc4146ad866cb0cb008fe1fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:24:29.434651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=9 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:30.248384 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:31.261542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33e02-a830-41b6-ba03-cae932aefda4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:31.262051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33e02-a830-41b6-ba03-cae932aefda4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:31.262051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33e02-a830-41b6-ba03-cae932aefda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:31.281594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-edc33e02-a830-41b6-ba03-cae932aefda4 None None] MFA Rules not processed for user `208fda1fb75d43729d8eef8c89f8cd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:31.283046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-edc33e02-a830-41b6-ba03-cae932aefda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:31.368403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1165/2336] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:24:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:33.458001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:33.459126 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:33.542285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ff74-5e4c-4051-a80f-fd958aa2c8fd admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:33.547087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:33.548096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:33.548442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:33.548832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:33.550879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:33.623665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:33.625282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:33.636575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1172/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:24:34.508359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89125dcb-4d58-45c7-9252-431131a88d78 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:34.509229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89125dcb-4d58-45c7-9252-431131a88d78 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:34.509727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89125dcb-4d58-45c7-9252-431131a88d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:34.539928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-89125dcb-4d58-45c7-9252-431131a88d78 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:34.541938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-89125dcb-4d58-45c7-9252-431131a88d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:34.627227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1166/2338] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:34.671864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:34.673328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:34.755477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e3a1-9d19-4e1c-9af9-8fae43db29f5 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:34.761751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:34.762368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:34.762646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:34.762914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:34.773529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:34.775771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:34.784771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1173/2339] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:24:40.493125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:40.494262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:40.494912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:40.529617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:40.531252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:40.550948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1167/2340] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:24:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:40.710726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:40.726021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdc123-c050-495e-8dec-76b2a9ba90c8 service swift] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:40.747238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bc0e0-c4b2-46d4-bed4-9e93cd17603b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:40.748457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bc0e0-c4b2-46d4-bed4-9e93cd17603b service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:40.749436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bc0e0-c4b2-46d4-bed4-9e93cd17603b service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:40.750446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bc0e0-c4b2-46d4-bed4-9e93cd17603b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:40.775912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bc0e0-c4b2-46d4-bed4-9e93cd17603b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:40.778318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bc0e0-c4b2-46d4-bed4-9e93cd17603b service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:40.791586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1174/2341] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:24:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:24:50.523787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=53 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:50.787349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:24:56.063511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:56.065011 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:56.134099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000aba42-c63d-49c3-a5e2-472ef5a65c90 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:56.138905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:56.139566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:56.139851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:56.140102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:56.142186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:56.248262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:56.249833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:56.294112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1168/2342] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:24:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:24:58.824396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:58.824939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:58.825190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:58.845898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:24:58.847698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:24:58.854967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1175/2343] 10.222.0.18 () {58 vars in 967 bytes} [Tue Sep 6 04:24:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:24:58.869525 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:24:58.880615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd16964-dd96-450c-b863-5ad304ef8440 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:24:58.886139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:24:58.886880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:24:58.887277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:24:58.887650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:24:58.899023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:24:58.900645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:24:58.913098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1169/2344] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:25:01.412233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:01.413811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:01.492432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a55e3-92a4-4763-9da8-8cbce6ceea24 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:01.497213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:01.497891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:01.498188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:01.498452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] PATH_INFO: `/v3/users/51af3e131caf4dd8b533816bb9abd4e2` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:01.500105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51af3e131caf4dd8b533816bb9abd4e2)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:01.502089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:01.559063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51af3e131caf4dd8b533816bb9abd4e2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.566675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51af3e131caf4dd8b533816bb9abd4e2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.579053 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51af3e131caf4dd8b533816bb9abd4e2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.579770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51af3e131caf4dd8b533816bb9abd4e2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.580383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51af3e131caf4dd8b533816bb9abd4e2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.594179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1176/2345] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:01 2022] DELETE /identity/v3/users/51af3e131caf4dd8b533816bb9abd4e2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:01.631312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:01.632758 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:01.651924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245e04-246f-4f2c-98aa-48c20ecc05fe service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:01.721401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:01.722282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:01.722663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:01.723071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] PATH_INFO: `/v3/users/1b2775c37b7042a1a447c78076dfcd46` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:01.724307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2775c37b7042a1a447c78076dfcd46)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:01.726225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:01.770492 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:01.778037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2775c37b7042a1a447c78076dfcd46'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.785243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2775c37b7042a1a447c78076dfcd46'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.798184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2775c37b7042a1a447c78076dfcd46'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.799213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2775c37b7042a1a447c78076dfcd46'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.800404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2775c37b7042a1a447c78076dfcd46'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:01.813917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1170/2346] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:01 2022] DELETE /identity/v3/users/1b2775c37b7042a1a447c78076dfcd46 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:01.877358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:01.879960 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:01.914243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd408-3e37-45c6-9157-b1bbe1aee985 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:01.983030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:01.983902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:01.984359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:01.984782 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] PATH_INFO: `/v3/projects/1a06a4fca452449b8c1e35047c145772` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:01.986080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a06a4fca452449b8c1e35047c145772)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:01.988738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.012520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:02.031537 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.033294 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.052652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36111e62-61f7-490f-b875-18cb18de303a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.059406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a06a4fca452449b8c1e35047c145772', 'request_id': 'req-4a70f58d-6668-406a-8820-9b548a5b6591'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.069653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a06a4fca452449b8c1e35047c145772', 'request_id': 'req-4a70f58d-6668-406a-8820-9b548a5b6591'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.076957 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a06a4fca452449b8c1e35047c145772', 'request_id': 'req-4a70f58d-6668-406a-8820-9b548a5b6591'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.092476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] The token cache is being invalidate because project 1a06a4fca452449b8c1e35047c145772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:02.093002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.093797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-4a70f58d-6668-406a-8820-9b548a5b6591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.096089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1177/2347] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:01 2022] DELETE /identity/v3/projects/1a06a4fca452449b8c1e35047c145772 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:02.103037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0bad-4c9e-42e8-ac51-443193eb40ac None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.103327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0bad-4c9e-42e8-ac51-443193eb40ac None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.103667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0bad-4c9e-42e8-ac51-443193eb40ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.127963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-743d0bad-4c9e-42e8-ac51-443193eb40ac None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:02.130452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.131119 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.131413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.131891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] PATH_INFO: `/v3/projects/93cfadaa464749da9a50e86dcea09d0c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.133042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=93cfadaa464749da9a50e86dcea09d0c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.134937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.136194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-743d0bad-4c9e-42e8-ac51-443193eb40ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.147814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1178/2348] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:25:02.156241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52402c1f-95a1-4854-b5c8-20e74eb3c365 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.156553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52402c1f-95a1-4854-b5c8-20e74eb3c365 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.156830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52402c1f-95a1-4854-b5c8-20e74eb3c365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.180819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-52402c1f-95a1-4854-b5c8-20e74eb3c365 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:02.182035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-52402c1f-95a1-4854-b5c8-20e74eb3c365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.191819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cfadaa464749da9a50e86dcea09d0c', 'request_id': 'req-81792ec9-2809-4401-bfe5-830beca220fa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.209518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cfadaa464749da9a50e86dcea09d0c', 'request_id': 'req-81792ec9-2809-4401-bfe5-830beca220fa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.226296 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cfadaa464749da9a50e86dcea09d0c', 'request_id': 'req-81792ec9-2809-4401-bfe5-830beca220fa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.239641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] The token cache is being invalidate because project 93cfadaa464749da9a50e86dcea09d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:02.239950 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.240611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.243412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1171/2349] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:02 2022] DELETE /identity/v3/projects/93cfadaa464749da9a50e86dcea09d0c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:02.246673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.248511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.275720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1179/2350] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:25:02.280010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52402c1f-95a1-4854-b5c8-20e74eb3c365 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.289987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52402c1f-95a1-4854-b5c8-20e74eb3c365 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.305037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:02.308506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.309192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.309473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.309755 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.310413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:25:02.310736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.312603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.325708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1180/2351] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:25:02.329299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792ec9-2809-4401-bfe5-830beca220fa admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.330006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.336280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.337600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.337801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.338102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] PATH_INFO: `/v3/users/9110eb4ee2434d818617d0c7eb3b6ffa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.339328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9110eb4ee2434d818617d0c7eb3b6ffa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.340781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fef7-e087-4053-8e83-481a7a2ec23e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.341607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.346723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.347349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.347744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.349047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.349047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.350715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.388309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1181/2352] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:25:02 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:25:02.392760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.405305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9110eb4ee2434d818617d0c7eb3b6ffa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.414437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9110eb4ee2434d818617d0c7eb3b6ffa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.432145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9110eb4ee2434d818617d0c7eb3b6ffa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.432905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9110eb4ee2434d818617d0c7eb3b6ffa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.433684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9110eb4ee2434d818617d0c7eb3b6ffa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.453475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1172/2353] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:02 2022] DELETE /identity/v3/users/9110eb4ee2434d818617d0c7eb3b6ffa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:25:02.482294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c7f6-8051-496a-9d6d-bb90d098f155 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.488213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:02.564147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.565142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.565496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.565835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.566554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.568912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.608471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.609959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.612327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1182/2354] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:25:02 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:02.625087 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e45afd-3237-4f41-b0ec-c4d068d0b1da admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.632302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1a470-60d9-42ea-945b-17b60e288585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.632914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a470-60d9-42ea-945b-17b60e288585 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.633186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a470-60d9-42ea-945b-17b60e288585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.634024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a470-60d9-42ea-945b-17b60e288585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.634837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1a470-60d9-42ea-945b-17b60e288585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.637423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1a470-60d9-42ea-945b-17b60e288585 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.649524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1173/2355] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:02.654196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.667703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533365d-ee11-4ac5-90a7-d184695c5806 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.680029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.680695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.680953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.681228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.681881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.683563 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.699559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70528748-a8d6-4f57-9c79-75c4e951589e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.699771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70528748-a8d6-4f57-9c79-75c4e951589e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.700184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1183/2356] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:25:02.700491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70528748-a8d6-4f57-9c79-75c4e951589e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.702212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1174/2357] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:25:02.704849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.713658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d17f50-357c-4ce4-a4aa-e3b96d6a398c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.714324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d17f50-357c-4ce4-a4aa-e3b96d6a398c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.714756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d17f50-357c-4ce4-a4aa-e3b96d6a398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.723852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d8d91-9eba-4a5b-9305-77cc0f3e2a0a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.757812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d6d17f50-357c-4ce4-a4aa-e3b96d6a398c None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:02.759259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6d17f50-357c-4ce4-a4aa-e3b96d6a398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.761229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.762035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.762319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.762636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] PATH_INFO: `/v3/projects/48a47296695d4e6ab32eefef9bae8f7e/users/7b1cb733b851492099c268347ea4a6d6/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.783993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a47296695d4e6ab32eefef9bae8f7e, user_id=7b1cb733b851492099c268347ea4a6d6, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.786695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.802049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1184/2358] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:25:02 2022] PUT /identity/v3/projects/48a47296695d4e6ab32eefef9bae8f7e/users/7b1cb733b851492099c268347ea4a6d6/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:02.803193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.812101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.846206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1175/2359] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:02.847908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.847908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.848110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.879190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] MFA Rules not processed for user `7b1cb733b851492099c268347ea4a6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:02.880523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.905448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ce0a9-7252-4e65-84cb-6399950a4506 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:02.910879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:02.911719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:02.912110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:02.912448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] PATH_INFO: `/v3/projects/b6a29384dcc345d798c2a07109c9f3e9` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:02.913617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a29384dcc345d798c2a07109c9f3e9)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:02.915295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:02.915717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:02.949952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1176/2360] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:02.954248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:02.955165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:02.966593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a29384dcc345d798c2a07109c9f3e9', 'request_id': 'req-8e724466-cb88-4df4-8383-667b762e254a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.975438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a29384dcc345d798c2a07109c9f3e9', 'request_id': 'req-8e724466-cb88-4df4-8383-667b762e254a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.983657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a29384dcc345d798c2a07109c9f3e9', 'request_id': 'req-8e724466-cb88-4df4-8383-667b762e254a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:02.985001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:03.005949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] The token cache is being invalidate because project b6a29384dcc345d798c2a07109c9f3e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:03.006251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:03.006935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:03.008484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1185/2361] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:02 2022] DELETE /identity/v3/projects/b6a29384dcc345d798c2a07109c9f3e9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:03.009398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.011064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.024684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e803b9-8cb3-419b-be34-b2450daf5278 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.069977 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724466-cb88-4df4-8383-667b762e254a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.073612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2e1a-3dfd-434c-b537-03bdd505106f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.074317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2e1a-3dfd-434c-b537-03bdd505106f service glance] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.074622 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2e1a-3dfd-434c-b537-03bdd505106f service glance] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.074856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2e1a-3dfd-434c-b537-03bdd505106f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.075240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef6d77-150c-42e7-8c17-5cdd1ef1d858 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.075871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6d77-150c-42e7-8c17-5cdd1ef1d858 service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.076150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6d77-150c-42e7-8c17-5cdd1ef1d858 service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.076420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6d77-150c-42e7-8c17-5cdd1ef1d858 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.076617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-74fd2e1a-3dfd-434c-b537-03bdd505106f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.078104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9aef6d77-150c-42e7-8c17-5cdd1ef1d858 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.137500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2e1a-3dfd-434c-b537-03bdd505106f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.138857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2e1a-3dfd-434c-b537-03bdd505106f service glance] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.148671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1186/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:03.149116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef6d77-150c-42e7-8c17-5cdd1ef1d858 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.149818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf501-98b1-426d-9fb2-b199072254b5 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.150100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf501-98b1-426d-9fb2-b199072254b5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.150374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf501-98b1-426d-9fb2-b199072254b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.150609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef6d77-150c-42e7-8c17-5cdd1ef1d858 service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.168485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1177/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:03.173205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8e7bf501-98b1-426d-9fb2-b199072254b5 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:03.175049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8e7bf501-98b1-426d-9fb2-b199072254b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.248444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95c36b-f1a7-4b58-a13d-cc9e55a0c458 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.248722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95c36b-f1a7-4b58-a13d-cc9e55a0c458 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.249140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95c36b-f1a7-4b58-a13d-cc9e55a0c458 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.250461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1178/2364] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:25:03.251171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1187/2365] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:03.258936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.259092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e0f8-27eb-4792-aee1-c8ed8fd235d8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.259445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e0f8-27eb-4792-aee1-c8ed8fd235d8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.259647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.259760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e0f8-27eb-4792-aee1-c8ed8fd235d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.260093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.280793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3b39e0f8-27eb-4792-aee1-c8ed8fd235d8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:03.282059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3b39e0f8-27eb-4792-aee1-c8ed8fd235d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.283349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] MFA Rules not processed for user `bf28e8b35a8246778b66c59164947add`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:03.284694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.293542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1188/2366] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:03.294413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39e0f8-27eb-4792-aee1-c8ed8fd235d8 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.304520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39e0f8-27eb-4792-aee1-c8ed8fd235d8 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.309298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.309931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.310149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.310418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.311057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:25:03.311355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.313019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.324411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:03.326550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1189/2367] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:25:03.332163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.342215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163967c-70ce-4103-8388-6b02ee34d5a3 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.347032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.347661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.347946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.348224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.348888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.350806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.361412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1179/2368] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:03.374677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.376092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.384339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1190/2369] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:03.388139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.389657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56788d56-de18-4e65-9241-b18df76bd038 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.411449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:03.454941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.455718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.456068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.456398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.464641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.466199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.475472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1180/2370] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:25:03.477860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9713e-42a6-430e-bdcd-18ef8ff0fd80 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.483314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.484319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.484424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.484700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.485486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.488159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.513744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1191/2371] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:25:03.515053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.529981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859519-7efc-4ee7-967b-72b4d45ed5d8 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.537219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81491f-4185-4ffb-8541-f948a81285af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.537829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81491f-4185-4ffb-8541-f948a81285af admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.538105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81491f-4185-4ffb-8541-f948a81285af admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.538374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81491f-4185-4ffb-8541-f948a81285af admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.539019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81491f-4185-4ffb-8541-f948a81285af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.540655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81491f-4185-4ffb-8541-f948a81285af admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.552437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1181/2372] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:25:03.556429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.580670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af949d4-d01c-4ce9-ab4a-52a7e30f5f88 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.580973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362e9f-f8c1-4f47-8814-f1d1223b6e01 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.581385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362e9f-f8c1-4f47-8814-f1d1223b6e01 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.581723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362e9f-f8c1-4f47-8814-f1d1223b6e01 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.583126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1182/2373] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:25:03.585788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.586394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.586672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.586944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.587629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.589665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.592915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.593509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.593927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.601418 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1192/2374] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:03.608971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.619571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:03.621133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.631703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b43d4-75f7-4622-89bc-7023682456f0 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.637645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b5880-61c5-4d3b-b4d3-3988042bbb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.638407 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b5880-61c5-4d3b-b4d3-3988042bbb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.638619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b5880-61c5-4d3b-b4d3-3988042bbb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.638878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b5880-61c5-4d3b-b4d3-3988042bbb0f admin admin] PATH_INFO: `/v3/projects/cd761219d8b44ea78e7dd51374ae4f5c/users/b558fdcbdc224c479622b3df84be56a8/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.656104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b5880-61c5-4d3b-b4d3-3988042bbb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd761219d8b44ea78e7dd51374ae4f5c, user_id=b558fdcbdc224c479622b3df84be56a8, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.662396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b5880-61c5-4d3b-b4d3-3988042bbb0f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.682387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1193/2375] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:25:03 2022] PUT /identity/v3/projects/cd761219d8b44ea78e7dd51374ae4f5c/users/b558fdcbdc224c479622b3df84be56a8/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:25:03.693271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348779ee-7b67-4ff7-8052-1b246d923a64 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.693579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348779ee-7b67-4ff7-8052-1b246d923a64 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.693815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348779ee-7b67-4ff7-8052-1b246d923a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.697472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1183/2376] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:03.711348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.714445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.725119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-348779ee-7b67-4ff7-8052-1b246d923a64 None None] MFA Rules not processed for user `b558fdcbdc224c479622b3df84be56a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:03.726406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-348779ee-7b67-4ff7-8052-1b246d923a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:03.727929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1270ee2-1936-4866-97e6-55cf00763689 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.778404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.779172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.779490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.779936 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.792642 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1194/2377] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:03.796777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348779ee-7b67-4ff7-8052-1b246d923a64 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.799341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:03.848556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:03.849805 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.851608 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.862315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348779ee-7b67-4ff7-8052-1b246d923a64 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:03.863015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1184/2378] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:25:03.867437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:03.868048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:03.868324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:03.868594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:03.869250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:03.871233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:03.909805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1195/2379] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:25:03.913513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:03.932356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcbb95-21bf-4b01-a61b-a73a39260173 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.013645 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.015215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.015695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.015969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.016612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.020464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.060784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1185/2380] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:25:03 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:04.062315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.073186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759749f-758e-4b39-8cab-4d9659234fd7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.081666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.082278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.082560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.082827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.083653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.086133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.100796 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1196/2381] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:04.102698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.115536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a04f7-82de-4586-9aaf-25cbcbbc3ee2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.120430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2dde6-5719-4ae7-b1e9-2c89b906054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.121277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2dde6-5719-4ae7-b1e9-2c89b906054c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.121588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2dde6-5719-4ae7-b1e9-2c89b906054c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.121969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2dde6-5719-4ae7-b1e9-2c89b906054c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.122612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2dde6-5719-4ae7-b1e9-2c89b906054c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.124240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2dde6-5719-4ae7-b1e9-2c89b906054c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.136348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1186/2382] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:04.140405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.151661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35c2b-00e7-49da-8370-621d9fbc3858 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.157307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.158015 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.158336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.159202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] PATH_INFO: `/v3/projects/fb7371375347439c92f71d0a6a6b4753/users/9461aa5761c24c9aafc6c2783a620d32/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.195006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7371375347439c92f71d0a6a6b4753, user_id=9461aa5761c24c9aafc6c2783a620d32, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.197816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.215113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1197/2383] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:25:04 2022] PUT /identity/v3/projects/fb7371375347439c92f71d0a6a6b4753/users/9461aa5761c24c9aafc6c2783a620d32/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:25:04.226636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21081-9aa9-4704-bbc0-a80972d88713 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.227044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21081-9aa9-4704-bbc0-a80972d88713 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.227309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21081-9aa9-4704-bbc0-a80972d88713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.258836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-42c21081-9aa9-4704-bbc0-a80972d88713 None None] MFA Rules not processed for user `9461aa5761c24c9aafc6c2783a620d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:04.260126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-42c21081-9aa9-4704-bbc0-a80972d88713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:04.333869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1187/2384] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:04.340329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.410413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f172f3-4d59-48d1-806d-f5c177ecb7b3 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.415820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.416421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.416702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.416971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.417598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.419843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.448711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1198/2385] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:25:04 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:04.452908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21081-9aa9-4704-bbc0-a80972d88713 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.464390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21081-9aa9-4704-bbc0-a80972d88713 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.477251 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:04.529970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.530580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.530854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.531117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.531777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.533707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.555613 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1188/2386] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:25:04 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:04.559791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.572466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5db3e-27f9-46c4-9a79-ded6e73afa72 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.580282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.583543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.583861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.584102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.584762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.586420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.597724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1199/2387] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:04.601862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.612362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a1ee-cd17-4e13-8913-523e70c155b4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.617561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.618491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.618763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.619101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] PATH_INFO: `/v3/projects/80fcb04a332d4bceb0b834c806b613eb/users/c9b3138ed5b64d409de4ea417212c237/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.641026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fcb04a332d4bceb0b834c806b613eb, user_id=c9b3138ed5b64d409de4ea417212c237, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.644271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.659042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1189/2388] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:25:04 2022] PUT /identity/v3/projects/80fcb04a332d4bceb0b834c806b613eb/users/c9b3138ed5b64d409de4ea417212c237/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:25:04.663176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.673612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb9828-6646-4bad-9e30-a6aee6f8aa5f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.740567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a5ae0-751e-4070-b41f-15231fb4313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.741177 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5ae0-751e-4070-b41f-15231fb4313b admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.741460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5ae0-751e-4070-b41f-15231fb4313b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.741731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5ae0-751e-4070-b41f-15231fb4313b admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.742380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a5ae0-751e-4070-b41f-15231fb4313b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.744048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a5ae0-751e-4070-b41f-15231fb4313b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.754697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1200/2389] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:04.758985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:04.769354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091d5c3-b8c2-43ae-bc90-01bd1bc82fb4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:04.774287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:04.774946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.775217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.775516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] PATH_INFO: `/v3/projects/80fcb04a332d4bceb0b834c806b613eb/users/c9b3138ed5b64d409de4ea417212c237/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.777434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fcb04a332d4bceb0b834c806b613eb, user_id=c9b3138ed5b64d409de4ea417212c237, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:04.780240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:04.791748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1190/2390] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:25:04 2022] PUT /identity/v3/projects/80fcb04a332d4bceb0b834c806b613eb/users/c9b3138ed5b64d409de4ea417212c237/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:04.873161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65370-d576-4ba0-bc01-fef307b67027 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:04.873443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65370-d576-4ba0-bc01-fef307b67027 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:04.873751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65370-d576-4ba0-bc01-fef307b67027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:04.894700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:04.904070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-81a65370-d576-4ba0-bc01-fef307b67027 None None] MFA Rules not processed for user `c9b3138ed5b64d409de4ea417212c237`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:04.906426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-81a65370-d576-4ba0-bc01-fef307b67027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:04.981443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1201/2391] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:05.004372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:05.006140 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:05.069806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e103-0a6c-4d21-b522-0eac4c38304f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:05.073554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee7630-adde-4628-8b04-9843d7c2ad29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:05.074156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee7630-adde-4628-8b04-9843d7c2ad29 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:05.074430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee7630-adde-4628-8b04-9843d7c2ad29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:05.074695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee7630-adde-4628-8b04-9843d7c2ad29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:05.138558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee7630-adde-4628-8b04-9843d7c2ad29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:05.140133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee7630-adde-4628-8b04-9843d7c2ad29 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:05.155520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1191/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:06.712756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a65370-d576-4ba0-bc01-fef307b67027 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:06.716967 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790b8f-0acf-4e39-9bd6-763f5a21df28 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:06.717417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790b8f-0acf-4e39-9bd6-763f5a21df28 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:06.717515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790b8f-0acf-4e39-9bd6-763f5a21df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:06.728566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a65370-d576-4ba0-bc01-fef307b67027 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:06.732552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:06.733226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:06.733571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:06.733910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:06.742416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-12790b8f-0acf-4e39-9bd6-763f5a21df28 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:06.743720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12790b8f-0acf-4e39-9bd6-763f5a21df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:06.763503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:06.799704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:06.801495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:06.812026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1202/2393] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:06.818737 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1192/2394] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:25:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:06.833518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:06.835708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:06.917011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4a9e-f163-482a-ac54-49ab2d8dc3bf service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:06.922763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:06.923428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:06.923711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:06.924526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:06.934013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:06.936615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:06.948018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1203/2395] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:25:07.705603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790b8f-0acf-4e39-9bd6-763f5a21df28 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:07.715507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790b8f-0acf-4e39-9bd6-763f5a21df28 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:07.719187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc7d51-ab4a-40ed-887d-9e0f5ef82b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:07.719796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc7d51-ab4a-40ed-887d-9e0f5ef82b53 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:07.720076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc7d51-ab4a-40ed-887d-9e0f5ef82b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:07.720346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc7d51-ab4a-40ed-887d-9e0f5ef82b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:07.729893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc7d51-ab4a-40ed-887d-9e0f5ef82b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:07.731389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc7d51-ab4a-40ed-887d-9e0f5ef82b53 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:07.743417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1193/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:11.768666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:11.803169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:11.843173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca7bcb-f208-4b11-a291-2e42ef46c835 service swift] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:11.848095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:11.848779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:11.849057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:11.849431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] PATH_INFO: `/v3/users/b558fdcbdc224c479622b3df84be56a8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:11.850734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=b558fdcbdc224c479622b3df84be56a8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:11.852860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:11.900854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b558fdcbdc224c479622b3df84be56a8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:11.907694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b558fdcbdc224c479622b3df84be56a8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:11.924602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b558fdcbdc224c479622b3df84be56a8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:11.925449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b558fdcbdc224c479622b3df84be56a8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:11.926096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b558fdcbdc224c479622b3df84be56a8'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:11.940557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1204/2397] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:11 2022] DELETE /identity/v3/users/b558fdcbdc224c479622b3df84be56a8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:11.945207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:11.945665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:11.945765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:11.971221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:11.972463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:12.051529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1194/2398] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:12.059541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:12.061001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:12.126240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6362a-3d2f-4ee2-91fb-34fc25406dde admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:12.130840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:12.131537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:12.131766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:12.132038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:12.141527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:12.143098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:12.154180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1205/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:12.549482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:12.551147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:12.575623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f34c-6c67-4ee1-ae61-18902018d28f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:12.575828 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:12.577047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:12.577395 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:12.577847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] PATH_INFO: `/v3/projects/cd761219d8b44ea78e7dd51374ae4f5c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:12.579198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd761219d8b44ea78e7dd51374ae4f5c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:12.581965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:12.635901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd761219d8b44ea78e7dd51374ae4f5c', 'request_id': 'req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.644771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd761219d8b44ea78e7dd51374ae4f5c', 'request_id': 'req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.651582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd761219d8b44ea78e7dd51374ae4f5c', 'request_id': 'req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.664269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] The token cache is being invalidate because project cd761219d8b44ea78e7dd51374ae4f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:12.664767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.665431 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.667033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1195/2400] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:12 2022] DELETE /identity/v3/projects/cd761219d8b44ea78e7dd51374ae4f5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:12.671200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:12.684111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3696-bdb3-4a40-8a75-3a1cb4ada2cd service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:12.733497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:12.757735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:12.758372 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:12.758647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:12.758914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] PATH_INFO: `/v3/users/9461aa5761c24c9aafc6c2783a620d32` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:12.760048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9461aa5761c24c9aafc6c2783a620d32)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:12.762026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:12.812490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9461aa5761c24c9aafc6c2783a620d32'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.820335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9461aa5761c24c9aafc6c2783a620d32'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.840395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9461aa5761c24c9aafc6c2783a620d32'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.841214 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9461aa5761c24c9aafc6c2783a620d32'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.841853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9461aa5761c24c9aafc6c2783a620d32'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:12.858344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1206/2401] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:12 2022] DELETE /identity/v3/users/9461aa5761c24c9aafc6c2783a620d32 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:25:13.220694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:13.223298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:13.244895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4803ae-e77c-4a28-bacf-e2d65b5946cb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:13.292162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:13.328271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:13.328996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:13.329378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:13.329747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] PATH_INFO: `/v3/projects/fb7371375347439c92f71d0a6a6b4753` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:13.331135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7371375347439c92f71d0a6a6b4753)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:13.333170 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:13.389363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7371375347439c92f71d0a6a6b4753', 'request_id': 'req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.408846 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7371375347439c92f71d0a6a6b4753', 'request_id': 'req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.416248 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7371375347439c92f71d0a6a6b4753', 'request_id': 'req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.430285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] The token cache is being invalidate because project fb7371375347439c92f71d0a6a6b4753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:13.430587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.431224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.432717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1196/2402] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:13 2022] DELETE /identity/v3/projects/fb7371375347439c92f71d0a6a6b4753 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:13.436897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:13.438646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:13.452017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f41b6-1c62-4599-9bbf-7e77239f90b4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:13.514611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:13.515236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:13.515545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:13.515815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] PATH_INFO: `/v3/users/c9b3138ed5b64d409de4ea417212c237` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:13.516922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b3138ed5b64d409de4ea417212c237)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:13.518909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:13.710465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b3138ed5b64d409de4ea417212c237'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.718934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b3138ed5b64d409de4ea417212c237'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.728795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:13.736843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b3138ed5b64d409de4ea417212c237'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.738208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b3138ed5b64d409de4ea417212c237'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.742702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-706746a6-816e-4ce2-8ca7-38b5cc872753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b3138ed5b64d409de4ea417212c237'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:13.757650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1207/2403] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:13 2022] DELETE /identity/v3/users/c9b3138ed5b64d409de4ea417212c237 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:14.083426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:14.083426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:14.101109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23c1ce-6e98-4d64-8aa1-7dcbade9213a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:14.201345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:14.202094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.202506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.202803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] PATH_INFO: `/v3/projects/80fcb04a332d4bceb0b834c806b613eb` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.203984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fcb04a332d4bceb0b834c806b613eb)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:14.206058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:14.273509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fcb04a332d4bceb0b834c806b613eb', 'request_id': 'req-38e54b48-9bed-4818-b22c-ff8dfdad455c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:14.295180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fcb04a332d4bceb0b834c806b613eb', 'request_id': 'req-38e54b48-9bed-4818-b22c-ff8dfdad455c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:14.305876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fcb04a332d4bceb0b834c806b613eb', 'request_id': 'req-38e54b48-9bed-4818-b22c-ff8dfdad455c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:14.314359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:14.322306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] The token cache is being invalidate because project 80fcb04a332d4bceb0b834c806b613eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:14.322919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:14.323951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-38e54b48-9bed-4818-b22c-ff8dfdad455c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:14.333281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1197/2404] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:14 2022] DELETE /identity/v3/projects/80fcb04a332d4bceb0b834c806b613eb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:14.338237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9989-6048-4238-99c0-9545025e8115 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.338909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9989-6048-4238-99c0-9545025e8115 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.338909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9989-6048-4238-99c0-9545025e8115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.360360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5e1e9989-6048-4238-99c0-9545025e8115 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:14.361943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5e1e9989-6048-4238-99c0-9545025e8115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:14.450546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1208/2405] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:14.459312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df456-1a25-445d-961f-3584d9ebf038 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.459650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df456-1a25-445d-961f-3584d9ebf038 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.460066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df456-1a25-445d-961f-3584d9ebf038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.484027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3f2df456-1a25-445d-961f-3584d9ebf038 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:14.485263 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3f2df456-1a25-445d-961f-3584d9ebf038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:14.495541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1198/2406] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:14.499929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e9989-6048-4238-99c0-9545025e8115 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:14.514355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e9989-6048-4238-99c0-9545025e8115 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:14.520937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:14.521687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.521983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.522323 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.523200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:25:14.523633 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:14.525331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:14.538848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1209/2407] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:25:14.543138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2df456-1a25-445d-961f-3584d9ebf038 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:14.557780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2df456-1a25-445d-961f-3584d9ebf038 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:14.560097 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:14.560753 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.561030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.561326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.561985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:14.563934 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:14.604752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1199/2408] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:25:14 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:14.605918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:14.620465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982dce-a085-44d3-bd50-a8cb41811ce2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:14.696005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:14.696829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.697114 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.697404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.698067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:14.704136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:14.730544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1210/2409] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:25:14 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:25:14.731790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:14.744891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200572a9-b065-4586-81a7-b3d063546e7a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:14.750321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:14.750952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.751301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.751538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.752783 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:14.754414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:14.765001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1200/2410] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:25:14.769059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:14.779567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2a23-45ca-4d19-81e7-90ebd0c42c94 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:14.785066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83e13e-d8ef-48d5-975e-ead79fb5704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:14.785688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e13e-d8ef-48d5-975e-ead79fb5704d admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.785982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e13e-d8ef-48d5-975e-ead79fb5704d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.786239 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e13e-d8ef-48d5-975e-ead79fb5704d admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.786886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83e13e-d8ef-48d5-975e-ead79fb5704d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:14.788559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83e13e-d8ef-48d5-975e-ead79fb5704d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:14.800868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1211/2411] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:14.806106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:14.816699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e0a4c-4689-45a3-a628-e634afdc685d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:14.821516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:14.822186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.822850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.822850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] PATH_INFO: `/v3/projects/c7e73ec279da45eebbc403a3dd873b33/users/4d813b87e13c4d41a705100db62099df/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.847273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e73ec279da45eebbc403a3dd873b33, user_id=4d813b87e13c4d41a705100db62099df, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:14.850227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:14.873756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1201/2412] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:25:14 2022] PUT /identity/v3/projects/c7e73ec279da45eebbc403a3dd873b33/users/4d813b87e13c4d41a705100db62099df/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:14.884137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b31ac-b601-468d-a65b-ee411ffcace1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:14.884426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b31ac-b601-468d-a65b-ee411ffcace1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:14.884758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b31ac-b601-468d-a65b-ee411ffcace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:14.922127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-476b31ac-b601-468d-a65b-ee411ffcace1 None None] MFA Rules not processed for user `4d813b87e13c4d41a705100db62099df`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:14.923353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-476b31ac-b601-468d-a65b-ee411ffcace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:14.970240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:15.019517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1212/2413] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:15.034206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:15.043738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:15.108091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0db492-5c59-4774-9092-1881a3315f28 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:15.111941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117ef24-bd03-4f86-b798-4f370a3f6671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:15.112587 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ef24-bd03-4f86-b798-4f370a3f6671 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:15.112895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ef24-bd03-4f86-b798-4f370a3f6671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:15.113141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ef24-bd03-4f86-b798-4f370a3f6671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:15.123018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117ef24-bd03-4f86-b798-4f370a3f6671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:15.124495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117ef24-bd03-4f86-b798-4f370a3f6671 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:15.141047 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1202/2414] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:15.168381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b31ac-b601-468d-a65b-ee411ffcace1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:15.237683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b31ac-b601-468d-a65b-ee411ffcace1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:15.243628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:15.244463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:15.244959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:15.245238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] PATH_INFO: `/v3/users/4d813b87e13c4d41a705100db62099df` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:15.247507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d813b87e13c4d41a705100db62099df)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:15.249819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:15.323007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d813b87e13c4d41a705100db62099df'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:15.333774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d813b87e13c4d41a705100db62099df'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:15.350973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d813b87e13c4d41a705100db62099df'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:15.352076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d813b87e13c4d41a705100db62099df'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:15.352702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d813b87e13c4d41a705100db62099df'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:15.374910 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1213/2415] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:15 2022] DELETE /identity/v3/users/4d813b87e13c4d41a705100db62099df => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:15.377113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:15.377647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:15.387813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:15.415833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:15.418050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:15.484915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1203/2416] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:15.495740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:15.497290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:15.566052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9863cd8-b68d-4da3-8669-d62737e164e9 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:15.569775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0331f-4ab3-4f7d-9ac0-051de2caac09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:15.570390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0331f-4ab3-4f7d-9ac0-051de2caac09 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:15.570665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0331f-4ab3-4f7d-9ac0-051de2caac09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:15.570917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0331f-4ab3-4f7d-9ac0-051de2caac09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:15.582068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0331f-4ab3-4f7d-9ac0-051de2caac09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:15.583583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0331f-4ab3-4f7d-9ac0-051de2caac09 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:15.599525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1214/2417] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:15.934627 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:15.936718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:15.956525 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc22dad-14f3-40d8-80e2-d807105698e0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:15.961835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:15.962229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:15.962507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:15.965921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] PATH_INFO: `/v3/projects/c7e73ec279da45eebbc403a3dd873b33` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:15.967476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e73ec279da45eebbc403a3dd873b33)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:15.969598 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.021573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:16.037678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e73ec279da45eebbc403a3dd873b33', 'request_id': 'req-32c11137-596e-4d16-97a8-0a471100476f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:16.052592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e73ec279da45eebbc403a3dd873b33', 'request_id': 'req-32c11137-596e-4d16-97a8-0a471100476f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:16.068462 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e73ec279da45eebbc403a3dd873b33', 'request_id': 'req-32c11137-596e-4d16-97a8-0a471100476f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:16.083281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] The token cache is being invalidate because project c7e73ec279da45eebbc403a3dd873b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:16.083281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:16.083281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32c11137-596e-4d16-97a8-0a471100476f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:16.084553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1204/2418] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:15 2022] DELETE /identity/v3/projects/c7e73ec279da45eebbc403a3dd873b33 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:25:16.090144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ebbf-0344-4e2d-859d-a29732af871b None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.090898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ebbf-0344-4e2d-859d-a29732af871b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.091284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ebbf-0344-4e2d-859d-a29732af871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.100699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:16.115931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-fa33ebbf-0344-4e2d-859d-a29732af871b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:16.124436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fa33ebbf-0344-4e2d-859d-a29732af871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:16.237276 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1215/2419] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:16.248041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73cf67-839a-47c2-836b-e1e6c70ed4e5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.248450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73cf67-839a-47c2-836b-e1e6c70ed4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.248747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73cf67-839a-47c2-836b-e1e6c70ed4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.285277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3a73cf67-839a-47c2-836b-e1e6c70ed4e5 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:16.286515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3a73cf67-839a-47c2-836b-e1e6c70ed4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:16.298984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1205/2420] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:16.301032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ebbf-0344-4e2d-859d-a29732af871b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:16.311883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ebbf-0344-4e2d-859d-a29732af871b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:16.318517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:16.319132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.319437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.319715 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.320365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:25:16.320666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:16.322273 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.337603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1216/2421] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:25:16.341818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73cf67-839a-47c2-836b-e1e6c70ed4e5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:16.351404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73cf67-839a-47c2-836b-e1e6c70ed4e5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:16.356244 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:16.356848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.357124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.357394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.358034 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:16.360005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.390253 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1206/2422] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:25:16 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:16.395671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:16.406922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dfecd-891b-4af9-8587-7a379a1fdf1a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:16.482517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:16.483129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.483430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.483702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.484336 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:16.486366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.509991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1217/2423] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:25:16 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:25:16.513882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:16.534506 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6dd92-3368-4cbb-b9d3-3f94b1e28d3e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:16.539141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:16.539780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.540056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.540320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.541002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:16.542589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.553913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1207/2424] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:16.557762 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:16.568826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b38e-ae8c-40a0-8674-4b95cbfac0cb admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:16.573669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc27ca-657a-4f7d-a32a-2c5a998e16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:16.574279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc27ca-657a-4f7d-a32a-2c5a998e16e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.574555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc27ca-657a-4f7d-a32a-2c5a998e16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.574958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc27ca-657a-4f7d-a32a-2c5a998e16e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.575650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc27ca-657a-4f7d-a32a-2c5a998e16e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:16.579399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc27ca-657a-4f7d-a32a-2c5a998e16e9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.592858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1218/2425] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:25:16.594566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:16.605148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60f92a-865b-4bc3-894f-db08c659ed24 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:16.609959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:16.610711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.611049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.611323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] PATH_INFO: `/v3/projects/4cba8f0c4005499780dcbd635559da5b/users/5fff273c5bd24f3585d44eef88ce781e/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.628844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cba8f0c4005499780dcbd635559da5b, user_id=5fff273c5bd24f3585d44eef88ce781e, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:16.631639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.646856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1208/2426] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:25:16 2022] PUT /identity/v3/projects/4cba8f0c4005499780dcbd635559da5b/users/5fff273c5bd24f3585d44eef88ce781e/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:16.657169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855758f4-7543-4a2d-b1d2-b125ee6df260 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.657462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855758f4-7543-4a2d-b1d2-b125ee6df260 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.657757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855758f4-7543-4a2d-b1d2-b125ee6df260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.688375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-855758f4-7543-4a2d-b1d2-b125ee6df260 None None] MFA Rules not processed for user `5fff273c5bd24f3585d44eef88ce781e`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:16.689675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-855758f4-7543-4a2d-b1d2-b125ee6df260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:16.770139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:16.792051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:16.792688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1219/2427] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:16.794698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:16.864799 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3c1f-7926-49a3-b4d9-1cf5a8c8ee1b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:16.870075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c35ab1-8660-4e38-880b-e8ac05b99b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:16.870714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35ab1-8660-4e38-880b-e8ac05b99b54 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:16.870997 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35ab1-8660-4e38-880b-e8ac05b99b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:16.871262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35ab1-8660-4e38-880b-e8ac05b99b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:16.880306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c35ab1-8660-4e38-880b-e8ac05b99b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:16.881756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c35ab1-8660-4e38-880b-e8ac05b99b54 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:16.891341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1209/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:25:18.322723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:18.323314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:18.323314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:18.342599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] MFA Rules not processed for user `5fff273c5bd24f3585d44eef88ce781e`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:18.343834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:18.351552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1220/2429] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:26.887635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:28.337716 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:29.012941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:29.013398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:29.013497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:29.033442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:29.034647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:29.093517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1210/2430] 10.222.0.18 () {58 vars in 967 bytes} [Tue Sep 6 04:25:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:25:29.105597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:29.106982 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:29.186553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e000cc8-e0d3-4a53-8afb-e72e7d9424a7 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:29.192201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3c63-9423-456a-a991-99010264e6c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:29.192806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3c63-9423-456a-a991-99010264e6c7 service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:29.193083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3c63-9423-456a-a991-99010264e6c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:29.193352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3c63-9423-456a-a991-99010264e6c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:29.212745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3c63-9423-456a-a991-99010264e6c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:29.214416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3c63-9423-456a-a991-99010264e6c7 service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:29.223032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1221/2431] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:25:30.725043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:30.727259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:30.831633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf1cd-4663-4be6-b6e6-f47f7d2f69c9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:30.838072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:30.838317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:30.838609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:30.838909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] PATH_INFO: `/v3/users/7b1cb733b851492099c268347ea4a6d6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:30.840025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1cb733b851492099c268347ea4a6d6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:30.841948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:30.915712 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1cb733b851492099c268347ea4a6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:30.923824 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1cb733b851492099c268347ea4a6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:30.942076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1cb733b851492099c268347ea4a6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:30.942985 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1cb733b851492099c268347ea4a6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:30.943739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1cb733b851492099c268347ea4a6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:30.961229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1211/2432] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:30 2022] DELETE /identity/v3/users/7b1cb733b851492099c268347ea4a6d6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:30.965514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:30.966370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:30.966853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:30.988883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:30.990226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:31.052327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1222/2433] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:31.062788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:31.064775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:31.094231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:31.128015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb00e3d-f174-4402-a20d-4badfbc6c696 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:31.131756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:31.132369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:31.132636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:31.132906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:31.142793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:31.144201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:31.153848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1212/2434] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:31.416820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:31.418296 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:31.435317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5111b-b18f-4eff-9157-ffb63ce76932 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:31.440118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:31.440748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:31.441100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:31.441282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] PATH_INFO: `/v3/projects/48a47296695d4e6ab32eefef9bae8f7e` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:31.442640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a47296695d4e6ab32eefef9bae8f7e)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:31.444596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:31.490571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a47296695d4e6ab32eefef9bae8f7e', 'request_id': 'req-ab85bbda-99fb-44e5-82fd-4397116c8d4d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:31.498509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a47296695d4e6ab32eefef9bae8f7e', 'request_id': 'req-ab85bbda-99fb-44e5-82fd-4397116c8d4d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:31.504279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a47296695d4e6ab32eefef9bae8f7e', 'request_id': 'req-ab85bbda-99fb-44e5-82fd-4397116c8d4d'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:31.515227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] The token cache is being invalidate because project 48a47296695d4e6ab32eefef9bae8f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:31.515446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:31.516080 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-ab85bbda-99fb-44e5-82fd-4397116c8d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:31.517600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1223/2435] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:31 2022] DELETE /identity/v3/projects/48a47296695d4e6ab32eefef9bae8f7e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:35.908276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:35.909686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:35.984750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bc9d4-e895-4ff4-8572-31b5c3e2e8fc service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:36.043514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:36.044116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:36.044393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:36.044665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:36.046390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:36.057836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:36.059416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:36.068970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1213/2436] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:38.136303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25218-0821-48fd-9295-aba4fb09077f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:38.136757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25218-0821-48fd-9295-aba4fb09077f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:38.136851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25218-0821-48fd-9295-aba4fb09077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:38.156078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-68c25218-0821-48fd-9295-aba4fb09077f None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:38.157773 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-68c25218-0821-48fd-9295-aba4fb09077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:38.166827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:38.214288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1224/2437] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:25:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:25:38.236784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:38.238457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:38.301111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:38.307491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b117762-a16e-479e-96f3-fd08b3ba1a5d service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:38.312522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:38.313144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:38.313427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:38.313701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:38.321657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:38.323241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:38.331194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1214/2438] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:25:38.833728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f571938-2f8a-474f-8deb-98c500699c61 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:38.834010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f571938-2f8a-474f-8deb-98c500699c61 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:38.834283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f571938-2f8a-474f-8deb-98c500699c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:38.854154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0f571938-2f8a-474f-8deb-98c500699c61 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:38.855343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0f571938-2f8a-474f-8deb-98c500699c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:38.863394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1225/2439] 10.222.0.18 () {58 vars in 967 bytes} [Tue Sep 6 04:25:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:38.875565 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:38.885964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfccb7-4ba8-4576-b05e-64e9163f2773 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:38.890870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:38.891511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:38.891787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:38.892056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:38.899838 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:38.901394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:38.909702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1215/2440] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:25:39.132331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df234f-8e7a-4149-93d0-31655323dcb1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:39.132614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df234f-8e7a-4149-93d0-31655323dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:39.132886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df234f-8e7a-4149-93d0-31655323dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:39.151973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-08df234f-8e7a-4149-93d0-31655323dcb1 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:39.153156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-08df234f-8e7a-4149-93d0-31655323dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:39.161182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1226/2441] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:39.172839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:39.183509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8af0-a49d-455e-8e5f-82e57fe58817 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:39.188416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:39.188994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:39.189268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:39.189535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:39.197284 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:39.198836 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:39.207094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1216/2442] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:25:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:25:39.519489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:39.519779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:39.520049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:39.539256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:39.540481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:39.547511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1227/2443] 10.222.0.18 () {58 vars in 967 bytes} [Tue Sep 6 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:39.559582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:39.570303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e18b2-2ddf-4ed0-95ea-3a1c575a604f service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:39.575258 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f310-d22d-41a6-861a-40f9c245ffd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:39.575865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f310-d22d-41a6-861a-40f9c245ffd8 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:39.576142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f310-d22d-41a6-861a-40f9c245ffd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:39.576407 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f310-d22d-41a6-861a-40f9c245ffd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:39.585102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497f310-d22d-41a6-861a-40f9c245ffd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:39.586657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497f310-d22d-41a6-861a-40f9c245ffd8 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:39.594430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1217/2444] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:25:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:25:41.655853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:41.657329 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:41.727308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695992-dbf6-49ac-b5eb-c39de5107955 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:41.731990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:41.732697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:41.732973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:41.733242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] PATH_INFO: `/v3/users/5fff273c5bd24f3585d44eef88ce781e` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:41.734883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fff273c5bd24f3585d44eef88ce781e)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:41.736845 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:41.789035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fff273c5bd24f3585d44eef88ce781e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:41.795916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fff273c5bd24f3585d44eef88ce781e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:41.808828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fff273c5bd24f3585d44eef88ce781e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:41.809530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fff273c5bd24f3585d44eef88ce781e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:41.810132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fff273c5bd24f3585d44eef88ce781e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:41.824170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1228/2445] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:25:41 2022] DELETE /identity/v3/users/5fff273c5bd24f3585d44eef88ce781e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:41.828641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:41.829111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:41.829226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:41.848600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:25:41.849803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:41.908767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1218/2446] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:25:41.918186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:41.919711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:41.939868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:41.979999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2a3d-c36c-4f12-98df-716a1c226e26 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:41.983635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6b5d5-4dc1-46cc-bb06-a06c1282512d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:41.984364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6b5d5-4dc1-46cc-bb06-a06c1282512d service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:41.985068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6b5d5-4dc1-46cc-bb06-a06c1282512d service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:41.985333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6b5d5-4dc1-46cc-bb06-a06c1282512d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:41.997048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6b5d5-4dc1-46cc-bb06-a06c1282512d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:41.998510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6b5d5-4dc1-46cc-bb06-a06c1282512d service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:42.008341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1229/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:25:42.183344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:25:42.185009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:25:42.199656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0dc07-9cd3-49de-9449-19fe7a5d912a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:25:42.205397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:25:42.207270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:25:42.207813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:25:42.208124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] PATH_INFO: `/v3/projects/4cba8f0c4005499780dcbd635559da5b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:25:42.209902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cba8f0c4005499780dcbd635559da5b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:25:42.213007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:25:42.263392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cba8f0c4005499780dcbd635559da5b', 'request_id': 'req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:42.272347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cba8f0c4005499780dcbd635559da5b', 'request_id': 'req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:42.280197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cba8f0c4005499780dcbd635559da5b', 'request_id': 'req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:42.292423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] The token cache is being invalidate because project 4cba8f0c4005499780dcbd635559da5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:25:42.292717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:42.294574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-523da019-8d7e-4b7e-8f20-fe0ed60aa72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:25:42.296281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1219/2448] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:25:42 2022] DELETE /identity/v3/projects/4cba8f0c4005499780dcbd635559da5b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:25:52.004011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=18 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:25:52.289278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:26:06.591527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664bb46-e181-4b48-8458-4fb7bc225bd7 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:26:06.592076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664bb46-e181-4b48-8458-4fb7bc225bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:26:06.592076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664bb46-e181-4b48-8458-4fb7bc225bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:26:06.610518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1664bb46-e181-4b48-8458-4fb7bc225bd7 None None] MFA Rules not processed for user `208fda1fb75d43729d8eef8c89f8cd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:26:06.611980 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1664bb46-e181-4b48-8458-4fb7bc225bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:26:06.664547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1230/2449] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:26:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:26:16.657929 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=25 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:26:18.552432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:26:18.552924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:26:18.553027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:26:18.572947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] MFA Rules not processed for user `f8f46235d0d34ba5bbb60e675002fc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:26:18.574147 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:26:18.628044 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1220/2450] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:26:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:26:28.621156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=25 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:26:38.640572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5c6b7-5112-45a1-9f01-4da8c87d6a63 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:26:38.641090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5c6b7-5112-45a1-9f01-4da8c87d6a63 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:26:38.641186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5c6b7-5112-45a1-9f01-4da8c87d6a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:26:38.659717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a0a5c6b7-5112-45a1-9f01-4da8c87d6a63 None None] MFA Rules not processed for user `73104db15e224f4ba00f9ab79ed46957`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:26:38.660938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a0a5c6b7-5112-45a1-9f01-4da8c87d6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:26:38.713918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1231/2451] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:26:48.707355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=25 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:09.583079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:09.584559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:09.663885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fd535-f8d1-41a9-b2f6-ae7a128bb26d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:09.668851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:09.669471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:09.669750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:09.670043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] PATH_INFO: `/v3/users/208fda1fb75d43729d8eef8c89f8cd12` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:09.671150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208fda1fb75d43729d8eef8c89f8cd12)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:09.673090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:09.718019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208fda1fb75d43729d8eef8c89f8cd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:09.724699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208fda1fb75d43729d8eef8c89f8cd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:09.737054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208fda1fb75d43729d8eef8c89f8cd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:09.737711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208fda1fb75d43729d8eef8c89f8cd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:09.738302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fef29ea8-7dfa-4c0b-949f-ce45d7fb1543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208fda1fb75d43729d8eef8c89f8cd12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:09.750673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1221/2452] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:27:09 2022] DELETE /identity/v3/users/208fda1fb75d43729d8eef8c89f8cd12 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:27:09.921928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5c6b7-5112-45a1-9f01-4da8c87d6a63 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:09.932937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5c6b7-5112-45a1-9f01-4da8c87d6a63 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:09.994969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:09.995658 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:09.995930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:09.996206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] PATH_INFO: `/v3/projects/19b9531b3d7c4969b62f404dab5dba5d` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:09.997586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b9531b3d7c4969b62f404dab5dba5d)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:09.999581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.052931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b9531b3d7c4969b62f404dab5dba5d', 'request_id': 'req-e3bac93d-f9c1-4573-8937-de7bd24d9533'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:10.060959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b9531b3d7c4969b62f404dab5dba5d', 'request_id': 'req-e3bac93d-f9c1-4573-8937-de7bd24d9533'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:10.070243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b9531b3d7c4969b62f404dab5dba5d', 'request_id': 'req-e3bac93d-f9c1-4573-8937-de7bd24d9533'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:10.083261 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] The token cache is being invalidate because project 19b9531b3d7c4969b62f404dab5dba5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:27:10.083595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:10.085585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-e3bac93d-f9c1-4573-8937-de7bd24d9533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:10.087520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1232/2453] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:27:09 2022] DELETE /identity/v3/projects/19b9531b3d7c4969b62f404dab5dba5d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:27:10.092973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4844-cfed-4fe9-8cd3-b48e735e21a7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.094062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4844-cfed-4fe9-8cd3-b48e735e21a7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.094062 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4844-cfed-4fe9-8cd3-b48e735e21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.117926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3adc4844-cfed-4fe9-8cd3-b48e735e21a7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:10.119217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3adc4844-cfed-4fe9-8cd3-b48e735e21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:10.186490 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1222/2454] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:10.194115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b92df-5bac-4fc6-8710-e82afa6409f4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.194476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b92df-5bac-4fc6-8710-e82afa6409f4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.194761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b92df-5bac-4fc6-8710-e82afa6409f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.217491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6c3b92df-5bac-4fc6-8710-e82afa6409f4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:10.218685 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6c3b92df-5bac-4fc6-8710-e82afa6409f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:10.226453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1233/2455] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:10.231681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4844-cfed-4fe9-8cd3-b48e735e21a7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:10.240635 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4844-cfed-4fe9-8cd3-b48e735e21a7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:10.245843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:10.246351 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.246630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.246896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.247572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:27:10.247872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:10.249458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.261343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1223/2456] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:27:10.265556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b92df-5bac-4fc6-8710-e82afa6409f4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:10.274552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b92df-5bac-4fc6-8710-e82afa6409f4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:10.279300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:10.279920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.280189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.280458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.281071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:10.282953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.309089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1234/2457] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:27:10 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:27:10.313288 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:10.323701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e054672-9e94-4347-bce0-97d5ac7129c0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:10.328120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:10.381917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:10.382505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.382776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.383041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.383707 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:10.386198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.406467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1224/2458] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:27:10 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:27:10.410597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:10.422017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07a01a-da3e-4c01-8384-805ef591f654 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:10.426517 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:10.427102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.427391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.427667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.428292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:10.429889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.440537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1235/2459] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:27:10.444481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:10.454992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e043185-3c36-4e18-9b49-0ceaab41f4f2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:10.459693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e631c1f-c4ef-4ba9-a2e5-d6f8add35b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:10.460283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e631c1f-c4ef-4ba9-a2e5-d6f8add35b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.460560 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e631c1f-c4ef-4ba9-a2e5-d6f8add35b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.460827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e631c1f-c4ef-4ba9-a2e5-d6f8add35b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.461463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e631c1f-c4ef-4ba9-a2e5-d6f8add35b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:10.463096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e631c1f-c4ef-4ba9-a2e5-d6f8add35b49 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.476625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1225/2460] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:27:10.481093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:10.491216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53675d7e-7c6f-4320-abb7-df378b3b73fc admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:10.496301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:10.497370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.497644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.497909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] PATH_INFO: `/v3/projects/fce09015b6434919ae0544039ca4ba64/users/eb9a096eb0524a62919110a6f863351d/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.512750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce09015b6434919ae0544039ca4ba64, user_id=eb9a096eb0524a62919110a6f863351d, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:10.515547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.527769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1236/2461] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:27:10 2022] PUT /identity/v3/projects/fce09015b6434919ae0544039ca4ba64/users/eb9a096eb0524a62919110a6f863351d/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:27:10.532871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0c00-8b18-4f99-bf1b-31e9fb726ecb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.533187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0c00-8b18-4f99-bf1b-31e9fb726ecb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.533463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0c00-8b18-4f99-bf1b-31e9fb726ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.552503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fa3a0c00-8b18-4f99-bf1b-31e9fb726ecb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:10.553696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fa3a0c00-8b18-4f99-bf1b-31e9fb726ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:10.610761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1226/2462] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:10.620793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:10.622454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:10.653302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:10.683520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a575e6-2c10-4c0e-bff6-330755821444 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:10.687209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:10.687846 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:10.688118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:10.688394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:10.697374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:10.698801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:10.707948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1237/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:14.824225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca3bb-804d-41d8-8d5c-6e81397adcbe None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:14.824772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca3bb-804d-41d8-8d5c-6e81397adcbe None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:14.824772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca3bb-804d-41d8-8d5c-6e81397adcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:14.856955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d84ca3bb-804d-41d8-8d5c-6e81397adcbe None None] MFA Rules not processed for user `eb9a096eb0524a62919110a6f863351d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:14.858115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d84ca3bb-804d-41d8-8d5c-6e81397adcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:14.925895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1227/2464] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:14.939880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:14.941433 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:15.027720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8f7c-e32e-4ec9-b88e-7dc690485aa5 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:15.033808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:15.034513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:15.034818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:15.035089 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:15.045355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:15.047002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:15.057217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1238/2465] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:16.733943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:16.734717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:16.734866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:16.763877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] MFA Rules not processed for user `eb9a096eb0524a62919110a6f863351d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:16.765282 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:16.773743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1228/2466] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:17.938023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:17.951787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f5352-6e4b-4dd5-bb56-88683c18fc3c service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:17.959027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca172-54b0-4a76-8251-7ccc1577f6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:17.959316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca172-54b0-4a76-8251-7ccc1577f6df service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:17.959628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca172-54b0-4a76-8251-7ccc1577f6df service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:17.959893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca172-54b0-4a76-8251-7ccc1577f6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:17.961667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-409ca172-54b0-4a76-8251-7ccc1577f6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:17.982739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca172-54b0-4a76-8251-7ccc1577f6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:17.984159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca172-54b0-4a76-8251-7ccc1577f6df service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:18.002413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1239/2467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:19.237753 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:19.239349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:19.251992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ddba2-ea9f-47e1-8627-d1de36d4e28c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:19.255550 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa83f2-3fa3-470b-9fcf-9728cf7064a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:19.256213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa83f2-3fa3-470b-9fcf-9728cf7064a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:19.256493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa83f2-3fa3-470b-9fcf-9728cf7064a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:19.256761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa83f2-3fa3-470b-9fcf-9728cf7064a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:19.258448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d1aa83f2-3fa3-470b-9fcf-9728cf7064a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:19.269781 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:19.272680 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa83f2-3fa3-470b-9fcf-9728cf7064a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:19.274267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa83f2-3fa3-470b-9fcf-9728cf7064a5 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:19.287744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1229/2468] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:22.576335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf395-f12a-4f37-b10c-7a4f5f090b4b None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:22.576873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf395-f12a-4f37-b10c-7a4f5f090b4b None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:22.576873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf395-f12a-4f37-b10c-7a4f5f090b4b None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:22.578228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1240/2469] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 04:27:22.584051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0caf3-1115-4f54-a2e5-5bda941d6d24 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:22.584500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0caf3-1115-4f54-a2e5-5bda941d6d24 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:22.584657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0caf3-1115-4f54-a2e5-5bda941d6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:22.605337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-abd0caf3-1115-4f54-a2e5-5bda941d6d24 None None] MFA Rules not processed for user `bf28e8b35a8246778b66c59164947add`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:22.606455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-abd0caf3-1115-4f54-a2e5-5bda941d6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:22.613489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1230/2470] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:27:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:22.626109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cf395-f12a-4f37-b10c-7a4f5f090b4b None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:22.637460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cf395-f12a-4f37-b10c-7a4f5f090b4b None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:22.640970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbf1e8-c283-4d0a-b035-128425a5eda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:22.641556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbf1e8-c283-4d0a-b035-128425a5eda8 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:22.641826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbf1e8-c283-4d0a-b035-128425a5eda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:22.642090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbf1e8-c283-4d0a-b035-128425a5eda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:22.649339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbf1e8-c283-4d0a-b035-128425a5eda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:22.651615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbf1e8-c283-4d0a-b035-128425a5eda8 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:22.660314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1241/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:22.743891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece6bb-b7ee-412b-82dd-b5d77e8f8384 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:22.744172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece6bb-b7ee-412b-82dd-b5d77e8f8384 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:22.744442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece6bb-b7ee-412b-82dd-b5d77e8f8384 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:22.745819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1231/2472] 10.222.0.18 () {54 vars in 921 bytes} [Tue Sep 6 04:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:27:22.750772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:22.751056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:22.751326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:22.771646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] MFA Rules not processed for user `88339d0387834b8b8e833579efd7ee96`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:22.772858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:22.782848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1242/2473] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Sep 6 04:27:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:22.792788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece6bb-b7ee-412b-82dd-b5d77e8f8384 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:22.803532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece6bb-b7ee-412b-82dd-b5d77e8f8384 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:22.807172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:22.807797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:22.808074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:22.808343 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:22.818447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:22.819895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:22.830954 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1232/2474] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:31.500805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:31.502978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:31.556002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:31.557594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:31.577708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13befb-0011-467f-827c-656af81954d8 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:31.586608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773f1c3-c96e-4a48-ab9d-c74cfb2e28b3 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:31.587421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed068df-3df7-4b41-b99d-c9ac148bef67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:31.588369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed068df-3df7-4b41-b99d-c9ac148bef67 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:31.589391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed068df-3df7-4b41-b99d-c9ac148bef67 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:31.590126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed068df-3df7-4b41-b99d-c9ac148bef67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:31.591288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:31.592098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:31.592964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2ed068df-3df7-4b41-b99d-c9ac148bef67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:31.593629 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:31.593909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:31.596347 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:31.652885 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:31.679615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed068df-3df7-4b41-b99d-c9ac148bef67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:31.681554 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:31.682160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed068df-3df7-4b41-b99d-c9ac148bef67 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:31.683154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:31.704678 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1233/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:27:31.715416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1243/2476] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:32.876552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:32.877048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:32.877394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:32.897743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:32.899706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:32.975021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1234/2477] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:27:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:33.040021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:33.041682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:33.119731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947be2ac-cf23-445b-aa82-4d37929c6229 service glance] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:33.125903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:33.126542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:33.126966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:33.127248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:33.137055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:33.138679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:33.147623 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1244/2478] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:27:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:27:33.747355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:33.751535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:33.822620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732518-8285-4246-ba99-38bdc0a6d461 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:33.829454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:33.829454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:33.829454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:33.829454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:33.831519 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:33.874277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:33.904381 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:33.906902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:33.917777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1235/2479] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:43.144671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=43 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:43.912446 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=12 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:44.637877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:44.647247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dcc30-6fb1-4c77-b719-6fd66720204f service swift] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:44.651599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da28fc-2250-47ae-9d97-bef09b853c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:44.652191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da28fc-2250-47ae-9d97-bef09b853c9c service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:44.652463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da28fc-2250-47ae-9d97-bef09b853c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:44.652727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da28fc-2250-47ae-9d97-bef09b853c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:44.654413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e8da28fc-2250-47ae-9d97-bef09b853c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:44.664196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da28fc-2250-47ae-9d97-bef09b853c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:44.665608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da28fc-2250-47ae-9d97-bef09b853c9c service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:44.673950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1245/2480] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:49.802714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:49.812867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb75ac8-ba13-4d1f-aa6f-25cd34e977c8 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:49.816471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32d98-51a8-48c0-bf59-686c381987e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:49.817102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32d98-51a8-48c0-bf59-686c381987e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:49.817384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32d98-51a8-48c0-bf59-686c381987e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:49.817674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32d98-51a8-48c0-bf59-686c381987e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:49.821027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bea32d98-51a8-48c0-bf59-686c381987e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:49.832686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32d98-51a8-48c0-bf59-686c381987e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:49.834107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32d98-51a8-48c0-bf59-686c381987e2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:49.849984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1236/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:50.195311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fff14-caef-416a-921b-0f232d89e188 None None] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:50.195784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fff14-caef-416a-921b-0f232d89e188 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:50.195893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fff14-caef-416a-921b-0f232d89e188 None None] PATH_INFO: `/` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:50.197268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1246/2482] 10.222.0.18 () {54 vars in 961 bytes} [Tue Sep 6 04:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 04:27:50.202424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a20b7-ab02-4ddc-a6b3-cd8326238421 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:50.202709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a20b7-ab02-4ddc-a6b3-cd8326238421 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:50.202984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a20b7-ab02-4ddc-a6b3-cd8326238421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:50.223159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-292a20b7-ab02-4ddc-a6b3-cd8326238421 None None] MFA Rules not processed for user `bbd74e1c4445439fa55b53f56f2befce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:50.224399 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-292a20b7-ab02-4ddc-a6b3-cd8326238421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:50.286291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1237/2483] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Sep 6 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:50.293990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fff14-caef-416a-921b-0f232d89e188 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:50.308950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fff14-caef-416a-921b-0f232d89e188 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:50.313868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:50.314450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:50.314728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:50.314996 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:50.316712 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:50.328414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:50.329991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:50.339720 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1247/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:52.125789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524d95-033a-4cbb-81d7-43438d73619c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:52.126447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524d95-033a-4cbb-81d7-43438d73619c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:52.126447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524d95-033a-4cbb-81d7-43438d73619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:52.145501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-67524d95-033a-4cbb-81d7-43438d73619c None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:52.146708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-67524d95-033a-4cbb-81d7-43438d73619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:52.154188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1238/2485] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:27:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:52.169339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:52.181066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3337-d95b-461a-b97f-b6d94df985af service placement] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:52.186789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:52.187410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:52.187689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:52.187958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:52.198121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:52.198121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:52.208681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1248/2486] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:27:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:27:53.431076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524d95-033a-4cbb-81d7-43438d73619c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:53.440831 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524d95-033a-4cbb-81d7-43438d73619c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:53.444428 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:53.445025 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:53.445304 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:53.445573 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:53.447300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:53.462010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:53.463868 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:53.476551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1239/2487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:27:57.858973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:57.860489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:57.893362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a095df-aa72-48b1-bab0-ef7a4764a9ef service swift] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:57.900962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:57.902209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:57.902971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:57.904854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] PATH_INFO: `/v3/users/73104db15e224f4ba00f9ab79ed46957` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:57.906728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73104db15e224f4ba00f9ab79ed46957)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:57.908828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:57.956330 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73104db15e224f4ba00f9ab79ed46957'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:57.962947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73104db15e224f4ba00f9ab79ed46957'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:57.974409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73104db15e224f4ba00f9ab79ed46957'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:57.975065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73104db15e224f4ba00f9ab79ed46957'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:57.976288 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-d50a3c09-b7b8-4c00-89aa-5f6e70abee4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73104db15e224f4ba00f9ab79ed46957'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:57.993477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1249/2488] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:27:57 2022] DELETE /identity/v3/users/73104db15e224f4ba00f9ab79ed46957 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:27:58.221922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:58.234055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96804-27d4-458d-9ab3-2bca63bc86c7 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:58.330990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:58.331807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.332089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.332361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] PATH_INFO: `/v3/projects/84a6dab05a1248b18e64fdc81c29b1d5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.333507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a6dab05a1248b18e64fdc81c29b1d5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:58.336342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:58.399013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a6dab05a1248b18e64fdc81c29b1d5', 'request_id': 'req-502cdcb7-91a8-421c-a755-512eca90b62d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:58.406779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a6dab05a1248b18e64fdc81c29b1d5', 'request_id': 'req-502cdcb7-91a8-421c-a755-512eca90b62d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:58.412563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a6dab05a1248b18e64fdc81c29b1d5', 'request_id': 'req-502cdcb7-91a8-421c-a755-512eca90b62d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:58.414390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:58.431544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] The token cache is being invalidate because project 84a6dab05a1248b18e64fdc81c29b1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:27:58.431988 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:58.432723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-502cdcb7-91a8-421c-a755-512eca90b62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:27:58.434494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1240/2489] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:27:58 2022] DELETE /identity/v3/projects/84a6dab05a1248b18e64fdc81c29b1d5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:27:58.439350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8bb67-840b-4ef5-bd64-004d5e9053a1 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.439667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8bb67-840b-4ef5-bd64-004d5e9053a1 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.439942 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8bb67-840b-4ef5-bd64-004d5e9053a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.460313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-97e8bb67-840b-4ef5-bd64-004d5e9053a1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:58.461523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-97e8bb67-840b-4ef5-bd64-004d5e9053a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:58.527436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1250/2490] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:58.534875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06207-cb12-4c80-8d62-0437b2f3cf74 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.535168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06207-cb12-4c80-8d62-0437b2f3cf74 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.535467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06207-cb12-4c80-8d62-0437b2f3cf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.556751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b6a06207-cb12-4c80-8d62-0437b2f3cf74 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:58.557992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b6a06207-cb12-4c80-8d62-0437b2f3cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:58.570455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1241/2491] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:58.571548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8bb67-840b-4ef5-bd64-004d5e9053a1 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:58.581902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8bb67-840b-4ef5-bd64-004d5e9053a1 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:58.587555 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:58.588179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.588462 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.588737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.589395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:27:58.589698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:58.592257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:58.607002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1251/2492] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:27:58.611653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06207-cb12-4c80-8d62-0437b2f3cf74 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:58.623019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06207-cb12-4c80-8d62-0437b2f3cf74 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:58.628307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:58.628902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.629182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.629447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.630083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:58.632648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:58.660024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1242/2493] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:27:58 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:27:58.664153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:58.674049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5925-1ae6-42ec-b2ec-43b874441a6a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:58.695326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:58.751821 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:58.754769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.755222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.755664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.758067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:58.761001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:58.790922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1252/2494] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:27:58 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:27:58.794972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:58.822326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83922fc-97b6-4bb5-9d89-f05508d73c63 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:58.827794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:58.828547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.828926 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.829290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.830002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:58.831704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:58.846856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1243/2495] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:27:58.848665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:58.868826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428a3c-9354-4465-95d6-18b2b3107fb7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:58.881905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2256-cf85-42d6-8a4d-cae0f711b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:58.882854 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2256-cf85-42d6-8a4d-cae0f711b795 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.883300 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2256-cf85-42d6-8a4d-cae0f711b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.883771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2256-cf85-42d6-8a4d-cae0f711b795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.884973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2256-cf85-42d6-8a4d-cae0f711b795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:58.886759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2256-cf85-42d6-8a4d-cae0f711b795 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:58.900596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1253/2496] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:27:58.904583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:58.918491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4050e-a269-401c-bb1f-9057a3d004e1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:58.929136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:58.929811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.930099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.930350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] PATH_INFO: `/v3/projects/122f9acbc297482eab8bb4d22820f4a6/users/ce9c9732935c4703b1c809387330f269/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:58.946696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122f9acbc297482eab8bb4d22820f4a6, user_id=ce9c9732935c4703b1c809387330f269, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:58.949391 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:58.965532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1244/2497] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:27:58 2022] PUT /identity/v3/projects/122f9acbc297482eab8bb4d22820f4a6/users/ce9c9732935c4703b1c809387330f269/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:27:58.984614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b553167-1707-46fe-9af1-0b37fe44755f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:58.985159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b553167-1707-46fe-9af1-0b37fe44755f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:58.985577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b553167-1707-46fe-9af1-0b37fe44755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.019930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0b553167-1707-46fe-9af1-0b37fe44755f None None] MFA Rules not processed for user `ce9c9732935c4703b1c809387330f269`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:59.021136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0b553167-1707-46fe-9af1-0b37fe44755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:59.086641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1254/2498] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:59.092299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.182247 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae727126-dc92-4ec7-89f4-de81cdc66594 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.186957 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.187606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.187879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.188145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.188773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.190675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:59.223536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1245/2499] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:27:59 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:27:59.227986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b553167-1707-46fe-9af1-0b37fe44755f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.242963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b553167-1707-46fe-9af1-0b37fe44755f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.302933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.304085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.304365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.304637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.305267 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.307206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:59.331472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1255/2500] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:27:59 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:27:59.334231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.345393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbe117-5cd1-454c-b215-78c31bdfa870 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.350500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.351118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.351422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.351729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.352401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.354009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:59.369961 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1246/2501] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:27:59.371154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.391256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962eac62-1f4b-4655-ac1b-46e42befdf19 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.396195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.396858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.397168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.397441 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] PATH_INFO: `/v3/projects/3c1d068d66104a7ebb5f4289d2fd540a/users/607b44b796c0465995fabe79af2bd5a3/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.414123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1d068d66104a7ebb5f4289d2fd540a, user_id=607b44b796c0465995fabe79af2bd5a3, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.416935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:59.419534 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:59.443295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1256/2502] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:27:59 2022] PUT /identity/v3/projects/3c1d068d66104a7ebb5f4289d2fd540a/users/607b44b796c0465995fabe79af2bd5a3/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:27:59.447322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.458217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00bcae-b090-4b87-84c2-9a80643f47b5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.520410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423a722-0cc9-48ff-b0f4-57b94cd1e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.521018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a722-0cc9-48ff-b0f4-57b94cd1e9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.521301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a722-0cc9-48ff-b0f4-57b94cd1e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.521582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a722-0cc9-48ff-b0f4-57b94cd1e9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.522313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423a722-0cc9-48ff-b0f4-57b94cd1e9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.524566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423a722-0cc9-48ff-b0f4-57b94cd1e9e8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:59.530708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:27:59.536209 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1247/2503] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:27:59.541832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.554370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f3f9a-3e5c-4cb5-a097-12fa770bc99e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.559614 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.560484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.560904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.561243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] PATH_INFO: `/v3/projects/3c1d068d66104a7ebb5f4289d2fd540a/users/607b44b796c0465995fabe79af2bd5a3/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.563783 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1d068d66104a7ebb5f4289d2fd540a, user_id=607b44b796c0465995fabe79af2bd5a3, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.566631 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:59.583738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1257/2504] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:27:59 2022] PUT /identity/v3/projects/3c1d068d66104a7ebb5f4289d2fd540a/users/607b44b796c0465995fabe79af2bd5a3/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:27:59.594065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3524b-efb7-47e6-9dcd-85a26912359e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.594566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3524b-efb7-47e6-9dcd-85a26912359e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.594938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3524b-efb7-47e6-9dcd-85a26912359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.627629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6ba3524b-efb7-47e6-9dcd-85a26912359e None None] MFA Rules not processed for user `607b44b796c0465995fabe79af2bd5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:27:59.628786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6ba3524b-efb7-47e6-9dcd-85a26912359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:59.706261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1248/2505] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:27:59.714175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.715901 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:27:59.777448 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1c07-12c7-47c9-979f-e16a44cce8ec admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.781112 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.781710 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.781988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.782259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.792411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.793913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:27:59.804582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1258/2506] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:27:59.905178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3524b-efb7-47e6-9dcd-85a26912359e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:27:59.916647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3524b-efb7-47e6-9dcd-85a26912359e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:27:59.920614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4135787-8492-42bb-8ee3-d3c8f0bdd44a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:27:59.921283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135787-8492-42bb-8ee3-d3c8f0bdd44a service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:27:59.921562 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135787-8492-42bb-8ee3-d3c8f0bdd44a service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:27:59.921965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135787-8492-42bb-8ee3-d3c8f0bdd44a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:27:59.986666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4135787-8492-42bb-8ee3-d3c8f0bdd44a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:27:59.988141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4135787-8492-42bb-8ee3-d3c8f0bdd44a service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:00.000009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1249/2507] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:27:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:02.824225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:02.885195 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173811-220b-49e7-8f32-5f94d1233c91 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:02.889738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:02.890359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:02.890637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:02.890909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] PATH_INFO: `/v3/users/ce9c9732935c4703b1c809387330f269` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:02.892044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9c9732935c4703b1c809387330f269)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:02.893966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:02.939695 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9c9732935c4703b1c809387330f269'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:02.946997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9c9732935c4703b1c809387330f269'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:02.958765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9c9732935c4703b1c809387330f269'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:02.959486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9c9732935c4703b1c809387330f269'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:02.960098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9c9732935c4703b1c809387330f269'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:02.972172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1259/2508] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:02 2022] DELETE /identity/v3/users/ce9c9732935c4703b1c809387330f269 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:02.976729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:02.977257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:02.977257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:02.998316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:02.999554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:03.056829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1250/2509] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:03.066432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:03.067888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:03.073696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:03.126077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fffcf4-83e1-460c-88b5-6267d37ab056 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:03.129719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:03.130312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:03.130588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:03.130859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:03.140213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:03.141634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:03.150860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1260/2510] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:03.408355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:03.409802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:03.425236 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914f66b-89a8-45cb-adc0-69488953baba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:03.430918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:03.431595 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:03.432411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:03.432682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] PATH_INFO: `/v3/projects/122f9acbc297482eab8bb4d22820f4a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:03.433848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122f9acbc297482eab8bb4d22820f4a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:03.435807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:03.457272 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:03.482325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122f9acbc297482eab8bb4d22820f4a6', 'request_id': 'req-c6848ca7-afed-4989-8911-395757c0af78'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.489495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122f9acbc297482eab8bb4d22820f4a6', 'request_id': 'req-c6848ca7-afed-4989-8911-395757c0af78'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.495130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122f9acbc297482eab8bb4d22820f4a6', 'request_id': 'req-c6848ca7-afed-4989-8911-395757c0af78'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.505948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] The token cache is being invalidate because project 122f9acbc297482eab8bb4d22820f4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:03.506261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.506924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.508441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1251/2511] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:03 2022] DELETE /identity/v3/projects/122f9acbc297482eab8bb4d22820f4a6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:03.512569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:03.523187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca9da2-f5e1-4d90-a637-a59e71a40188 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:03.578983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:03.579635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:03.579915 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:03.580187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] PATH_INFO: `/v3/users/607b44b796c0465995fabe79af2bd5a3` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:03.581290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] RBAC: Authorizing `identity:delete_user(user_id=607b44b796c0465995fabe79af2bd5a3)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:03.583205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:03.630279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607b44b796c0465995fabe79af2bd5a3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.637103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607b44b796c0465995fabe79af2bd5a3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.649738 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607b44b796c0465995fabe79af2bd5a3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.650437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607b44b796c0465995fabe79af2bd5a3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.651040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-c6947e29-691d-4f79-9210-6f151427862f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607b44b796c0465995fabe79af2bd5a3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:03.667358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1261/2512] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:03 2022] DELETE /identity/v3/users/607b44b796c0465995fabe79af2bd5a3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:04.009788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.011303 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:04.025794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848ca7-afed-4989-8911-395757c0af78 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.082546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.083204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.083518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.083790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] PATH_INFO: `/v3/projects/3c1d068d66104a7ebb5f4289d2fd540a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.085495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1d068d66104a7ebb5f4289d2fd540a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.087482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.133604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1d068d66104a7ebb5f4289d2fd540a', 'request_id': 'req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:04.140987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1d068d66104a7ebb5f4289d2fd540a', 'request_id': 'req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:04.146453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1d068d66104a7ebb5f4289d2fd540a', 'request_id': 'req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:04.157869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] The token cache is being invalidate because project 3c1d068d66104a7ebb5f4289d2fd540a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:04.158149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:04.158763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac3ec69-1f3f-4bcd-93c1-a3321efcbac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:04.160270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1252/2513] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:04 2022] DELETE /identity/v3/projects/3c1d068d66104a7ebb5f4289d2fd540a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:04.165119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484871ff-5847-4fb6-a072-27a42841f718 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.165577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484871ff-5847-4fb6-a072-27a42841f718 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.165684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484871ff-5847-4fb6-a072-27a42841f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.184975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-484871ff-5847-4fb6-a072-27a42841f718 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:04.186189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-484871ff-5847-4fb6-a072-27a42841f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:04.204567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:04.247674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1262/2514] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:04.255242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274bb47-6fda-47b9-aab9-167bdda8b686 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.255551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274bb47-6fda-47b9-aab9-167bdda8b686 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.255821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274bb47-6fda-47b9-aab9-167bdda8b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.275350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b274bb47-6fda-47b9-aab9-167bdda8b686 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:04.276557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b274bb47-6fda-47b9-aab9-167bdda8b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:04.284328 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1253/2515] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:04.288979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484871ff-5847-4fb6-a072-27a42841f718 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.298612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484871ff-5847-4fb6-a072-27a42841f718 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.303807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.304393 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.304666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.304933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.305568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:28:04.305864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.307479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.319003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1263/2516] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:28:04.323293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274bb47-6fda-47b9-aab9-167bdda8b686 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.332689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274bb47-6fda-47b9-aab9-167bdda8b686 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.337827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.338412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.338682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.338945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.339615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.341508 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.367963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1254/2517] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:04 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:04.372095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.381988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a2a5-5316-4445-a140-e5261d19c1c7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.436789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.437312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.437589 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.437856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.438472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.440421 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.461387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1264/2518] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:04 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:04.465479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.476166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98666b02-2c73-4626-b798-50c2a1ad017b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.480744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.481327 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.481630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.481895 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.482528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.484390 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.486377 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:04.497650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1255/2519] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:04.498744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.508444 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2735c-9612-4c37-8d52-d6f2593c9387 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.513043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb56f8-a3cb-444d-a218-779fd14f15c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.513618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb56f8-a3cb-444d-a218-779fd14f15c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.513892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb56f8-a3cb-444d-a218-779fd14f15c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.514158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb56f8-a3cb-444d-a218-779fd14f15c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.514788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb56f8-a3cb-444d-a218-779fd14f15c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.516392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb56f8-a3cb-444d-a218-779fd14f15c5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.527185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1265/2520] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:28:04.531118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.541609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29744edd-0bb9-49dd-a1e4-89ea560765df admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.546300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.546940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.547218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.547549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] PATH_INFO: `/v3/projects/ec595aca2b6c444caf187e32dce735f5/users/0d6a0f7881a14e6f95db679c6658fd83/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.561790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec595aca2b6c444caf187e32dce735f5, user_id=0d6a0f7881a14e6f95db679c6658fd83, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.564478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.577067 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1256/2521] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:04 2022] PUT /identity/v3/projects/ec595aca2b6c444caf187e32dce735f5/users/0d6a0f7881a14e6f95db679c6658fd83/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:28:04.588859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2f93-6cef-4dd4-b934-b977c63499d9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.589143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2f93-6cef-4dd4-b934-b977c63499d9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.589416 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2f93-6cef-4dd4-b934-b977c63499d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.617538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1def2f93-6cef-4dd4-b934-b977c63499d9 None None] MFA Rules not processed for user `0d6a0f7881a14e6f95db679c6658fd83`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:04.618750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1def2f93-6cef-4dd4-b934-b977c63499d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:04.688423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1266/2522] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:04.692796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.758198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d484b3-c42d-4f62-b47e-b35988cb45ab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.762764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.763355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.763661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.763930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.764581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.766482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.792776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1257/2523] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:04 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:04.796802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2f93-6cef-4dd4-b934-b977c63499d9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.807312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2f93-6cef-4dd4-b934-b977c63499d9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.823723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:04.865492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.866101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.866381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.866684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.867355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.869340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.891849 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1267/2524] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:04 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:04.896203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.907491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f036ac-79f7-41b6-8dab-bd610efa9801 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.912239 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.912807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.913083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.913350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.914007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.915643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.926499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1258/2525] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:04.930933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.944135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb168-e1b9-486e-af1b-2903d4a8d903 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:04.948880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:04.949617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:04.949864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:04.950121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] PATH_INFO: `/v3/projects/1e82bf83cd36405b98ac40e80e985692/users/1efafc7285c9456688974af13f3bd1c8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:04.966358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e82bf83cd36405b98ac40e80e985692, user_id=1efafc7285c9456688974af13f3bd1c8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:04.969104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:04.982227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1268/2526] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:04 2022] PUT /identity/v3/projects/1e82bf83cd36405b98ac40e80e985692/users/1efafc7285c9456688974af13f3bd1c8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:04.986528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:04.997423 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866c11-9bc0-4d54-a167-64034a20a2f8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:05.055257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3e316-5b08-4a24-92f3-46406315a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:05.056022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e316-5b08-4a24-92f3-46406315a036 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.056221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e316-5b08-4a24-92f3-46406315a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.056493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e316-5b08-4a24-92f3-46406315a036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.057125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3e316-5b08-4a24-92f3-46406315a036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:05.058713 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3e316-5b08-4a24-92f3-46406315a036 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:05.068215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1259/2527] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:05.072993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:05.083097 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e622e-921b-43a3-a200-ea0efa400919 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:05.087713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:05.088348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.088624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.088894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] PATH_INFO: `/v3/projects/1e82bf83cd36405b98ac40e80e985692/users/1efafc7285c9456688974af13f3bd1c8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.090796 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e82bf83cd36405b98ac40e80e985692, user_id=1efafc7285c9456688974af13f3bd1c8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:05.093485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:05.103248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1269/2528] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:05 2022] PUT /identity/v3/projects/1e82bf83cd36405b98ac40e80e985692/users/1efafc7285c9456688974af13f3bd1c8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:28:05.113162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d9ae-26a2-4219-884a-318c5a46568f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.113446 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d9ae-26a2-4219-884a-318c5a46568f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.113717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d9ae-26a2-4219-884a-318c5a46568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.141882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8ac8d9ae-26a2-4219-884a-318c5a46568f None None] MFA Rules not processed for user `1efafc7285c9456688974af13f3bd1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:05.143098 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8ac8d9ae-26a2-4219-884a-318c5a46568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:05.175153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:05.211917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1260/2529] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:05.222992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:05.224769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:05.283257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c48f75-0784-4dad-a399-122220c81ad4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:05.287505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a8061-e50c-4f2b-9ec7-82cf5570e3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:05.288104 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8061-e50c-4f2b-9ec7-82cf5570e3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.288379 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8061-e50c-4f2b-9ec7-82cf5570e3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.288643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8061-e50c-4f2b-9ec7-82cf5570e3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.299934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a8061-e50c-4f2b-9ec7-82cf5570e3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:05.301382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a8061-e50c-4f2b-9ec7-82cf5570e3b1 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:05.312587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1270/2530] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:05.342323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8d9ae-26a2-4219-884a-318c5a46568f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:05.403313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8d9ae-26a2-4219-884a-318c5a46568f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:05.408043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:05.408671 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.408946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.409215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] PATH_INFO: `/v3/users/0d6a0f7881a14e6f95db679c6658fd83` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.410352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6a0f7881a14e6f95db679c6658fd83)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:05.412867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:05.458806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6a0f7881a14e6f95db679c6658fd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:05.467698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6a0f7881a14e6f95db679c6658fd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:05.480018 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6a0f7881a14e6f95db679c6658fd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:05.480720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6a0f7881a14e6f95db679c6658fd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:05.481341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6a0f7881a14e6f95db679c6658fd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:05.496589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1261/2531] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:05 2022] DELETE /identity/v3/users/0d6a0f7881a14e6f95db679c6658fd83 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:05.501073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.501354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.501688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.521222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:05.522404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:05.579048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1271/2532] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:05.588655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:05.590102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:05.644682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:05.648911 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0fcf-18b2-420b-ad4a-4d70e98c2aa0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:05.653610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:05.654226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.654662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.655277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.665599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:05.667048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:05.676610 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1262/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:05.943269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:05.944784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:05.956972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3395f-adec-46c3-b6ad-5fcd70f384ad None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:05.962012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:05.962652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:05.962952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:05.963218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] PATH_INFO: `/v3/projects/ec595aca2b6c444caf187e32dce735f5` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:05.964378 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec595aca2b6c444caf187e32dce735f5)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:05.966341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:05.977787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:06.014776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec595aca2b6c444caf187e32dce735f5', 'request_id': 'req-f9e0b575-ef76-4bf1-9385-519b7dc543b9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.022740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec595aca2b6c444caf187e32dce735f5', 'request_id': 'req-f9e0b575-ef76-4bf1-9385-519b7dc543b9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.028970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec595aca2b6c444caf187e32dce735f5', 'request_id': 'req-f9e0b575-ef76-4bf1-9385-519b7dc543b9'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.041290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] The token cache is being invalidate because project ec595aca2b6c444caf187e32dce735f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:06.041577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.042226 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.043934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1272/2534] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:05 2022] DELETE /identity/v3/projects/ec595aca2b6c444caf187e32dce735f5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:06.047839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:06.059585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe423-47f8-4ba4-8192-6f321c1b6e84 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:06.117469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:06.118090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.118367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.118633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] PATH_INFO: `/v3/users/1efafc7285c9456688974af13f3bd1c8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.119778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1efafc7285c9456688974af13f3bd1c8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:06.121696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:06.173350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1efafc7285c9456688974af13f3bd1c8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.181996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1efafc7285c9456688974af13f3bd1c8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.196789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1efafc7285c9456688974af13f3bd1c8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.198041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1efafc7285c9456688974af13f3bd1c8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.198192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-41827f34-2b8d-48ed-9c04-bb4501caf179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1efafc7285c9456688974af13f3bd1c8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.220308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1263/2535] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:06 2022] DELETE /identity/v3/users/1efafc7285c9456688974af13f3bd1c8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:06.500260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:06.501696 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:06.515325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b575-ef76-4bf1-9385-519b7dc543b9 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:06.571936 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:06.572553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.572826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.573116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] PATH_INFO: `/v3/projects/1e82bf83cd36405b98ac40e80e985692` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.574207 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e82bf83cd36405b98ac40e80e985692)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:06.576139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:06.619864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e82bf83cd36405b98ac40e80e985692', 'request_id': 'req-7cf6750a-8ce9-4d63-b023-54718cb74277'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.627231 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e82bf83cd36405b98ac40e80e985692', 'request_id': 'req-7cf6750a-8ce9-4d63-b023-54718cb74277'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.633255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e82bf83cd36405b98ac40e80e985692', 'request_id': 'req-7cf6750a-8ce9-4d63-b023-54718cb74277'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.644141 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] The token cache is being invalidate because project 1e82bf83cd36405b98ac40e80e985692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:06.644420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.645040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-7cf6750a-8ce9-4d63-b023-54718cb74277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:06.646479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1273/2536] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:06 2022] DELETE /identity/v3/projects/1e82bf83cd36405b98ac40e80e985692 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:06.651298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88291ed-95c5-487c-9965-967f5fc3a89b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.651611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88291ed-95c5-487c-9965-967f5fc3a89b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.651876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88291ed-95c5-487c-9965-967f5fc3a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.671348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f88291ed-95c5-487c-9965-967f5fc3a89b None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:06.672593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f88291ed-95c5-487c-9965-967f5fc3a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:06.734055 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1264/2537] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:06.742331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f399ee-d65c-4184-9c90-a631e3e7528d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.742613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f399ee-d65c-4184-9c90-a631e3e7528d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.744876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f399ee-d65c-4184-9c90-a631e3e7528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.766774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-55f399ee-d65c-4184-9c90-a631e3e7528d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:06.768021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-55f399ee-d65c-4184-9c90-a631e3e7528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:06.776260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1274/2538] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:06.780456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88291ed-95c5-487c-9965-967f5fc3a89b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:06.790023 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88291ed-95c5-487c-9965-967f5fc3a89b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:06.794530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:06.795118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.795416 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.795689 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.796330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:28:06.796624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:06.798201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:06.805243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:06.811291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1265/2539] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:28:06.815046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f399ee-d65c-4184-9c90-a631e3e7528d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:06.824827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f399ee-d65c-4184-9c90-a631e3e7528d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:06.829541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:06.830125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.830399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.830666 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.831353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:06.833285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:06.853962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:06.862777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1275/2540] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:06 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:06.867306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:06.877173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dba44-1eda-4a38-ad7f-77dcab638e96 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:06.933891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:06.934493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.934773 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.935046 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.935715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:06.937641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:06.957861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1266/2541] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:06 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:06.961986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:06.972191 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a098-d8f1-4cf6-badd-ce57f95f3a67 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:06.977260 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:06.977839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:06.978111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:06.978375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:06.979028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:06.980723 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:06.991332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1276/2542] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:06.995520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.005563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303337-9202-46c5-9d57-6c072f19ec31 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.010169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6add1-4406-42be-bfc4-def4da810f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.010755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6add1-4406-42be-bfc4-def4da810f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.011031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6add1-4406-42be-bfc4-def4da810f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.011300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6add1-4406-42be-bfc4-def4da810f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.011976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6add1-4406-42be-bfc4-def4da810f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.013563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6add1-4406-42be-bfc4-def4da810f1e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.024494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1267/2543] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:07.028892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.039306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a410da6-b3dc-40c3-9fd4-d3d69bc0a611 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.043883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.044513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.044787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.045051 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] PATH_INFO: `/v3/projects/9151270d18314c04a55d2382c89e2601/users/28f5c864464549dda40c99c2d7e37908/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.060419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9151270d18314c04a55d2382c89e2601, user_id=28f5c864464549dda40c99c2d7e37908, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.063103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.075474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1277/2544] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:07 2022] PUT /identity/v3/projects/9151270d18314c04a55d2382c89e2601/users/28f5c864464549dda40c99c2d7e37908/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:07.086617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697548bb-b18e-4dda-bd66-aa4d41f957f6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.087112 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697548bb-b18e-4dda-bd66-aa4d41f957f6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.087218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697548bb-b18e-4dda-bd66-aa4d41f957f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.114765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-697548bb-b18e-4dda-bd66-aa4d41f957f6 None None] MFA Rules not processed for user `28f5c864464549dda40c99c2d7e37908`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:07.116615 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-697548bb-b18e-4dda-bd66-aa4d41f957f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:07.179385 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1268/2545] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:07.183795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.244786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4d5d-a753-4386-b954-f38ae3a9ad7f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.249661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.250264 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.250539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.250807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.251474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.253549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.281621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1278/2546] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:07 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:07.285755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697548bb-b18e-4dda-bd66-aa4d41f957f6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.297241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697548bb-b18e-4dda-bd66-aa4d41f957f6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.356029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.356637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.356910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.357178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.358080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.360105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.371187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:07.390962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1269/2547] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:07 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:07.392525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.404010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df567c-7e6b-4b3a-b01d-2f1058d52b6e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.408926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.409527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.409806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.410077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.410748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.412944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.423625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1279/2548] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:07.427786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.437701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0487d1d-6b2c-4fa3-9e76-902a64692337 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.442221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.442855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.443136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.443422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] PATH_INFO: `/v3/projects/f27e1934edcf4a79829d8515598ca1d4/users/88ab8b10147c4ac5920a3381c8b41f70/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.457623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27e1934edcf4a79829d8515598ca1d4, user_id=88ab8b10147c4ac5920a3381c8b41f70, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.460803 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.472821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1270/2549] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:07 2022] PUT /identity/v3/projects/f27e1934edcf4a79829d8515598ca1d4/users/88ab8b10147c4ac5920a3381c8b41f70/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:28:07.477293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.487419 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca47c4-17a7-471d-89e6-a75ac96481ce admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.542427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491817a-f926-454f-bd81-2a9dc14d186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.543077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491817a-f926-454f-bd81-2a9dc14d186b admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.543211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491817a-f926-454f-bd81-2a9dc14d186b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.543510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491817a-f926-454f-bd81-2a9dc14d186b admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.544145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491817a-f926-454f-bd81-2a9dc14d186b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.545732 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491817a-f926-454f-bd81-2a9dc14d186b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.555229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1280/2550] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:07.559501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.569462 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e89b-7a8d-46ae-bf3f-0fd3c88a1cd7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.573952 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.574614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.574888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.575151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] PATH_INFO: `/v3/projects/f27e1934edcf4a79829d8515598ca1d4/users/88ab8b10147c4ac5920a3381c8b41f70/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.577076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27e1934edcf4a79829d8515598ca1d4, user_id=88ab8b10147c4ac5920a3381c8b41f70, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.579748 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.590057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1271/2551] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:07 2022] PUT /identity/v3/projects/f27e1934edcf4a79829d8515598ca1d4/users/88ab8b10147c4ac5920a3381c8b41f70/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:07.600406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.600689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.600979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.629643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] MFA Rules not processed for user `88ab8b10147c4ac5920a3381c8b41f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:07.631339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:07.655978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:07.702196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1281/2552] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:07.714659 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.716462 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:07.767309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.769071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:07.781906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b1c26-295c-48bc-a926-678d11c3859a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.787070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.787942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.788555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.789286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.806756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.808701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.820771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1272/2553] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:07.855808 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b016fc-82dc-4b93-bebd-a73c0e39e3f6 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.861259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314c009-6f75-468b-b459-37e83decf260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.861867 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c009-6f75-468b-b459-37e83decf260 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.862144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c009-6f75-468b-b459-37e83decf260 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.862414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c009-6f75-468b-b459-37e83decf260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.864200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b314c009-6f75-468b-b459-37e83decf260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:07.876933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314c009-6f75-468b-b459-37e83decf260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.878525 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314c009-6f75-468b-b459-37e83decf260 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:07.889545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:07.890338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1282/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:07.952797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdf1dd-d834-470a-b8d5-916bd252ba64 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:07.957412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:07.958029 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:07.958308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:07.958581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] PATH_INFO: `/v3/users/28f5c864464549dda40c99c2d7e37908` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:07.960281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f5c864464549dda40c99c2d7e37908)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:07.962177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:08.010636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f5c864464549dda40c99c2d7e37908'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.017915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f5c864464549dda40c99c2d7e37908'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.026488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:08.040434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f5c864464549dda40c99c2d7e37908'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.041457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f5c864464549dda40c99c2d7e37908'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.042080 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f5c864464549dda40c99c2d7e37908'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.055692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1273/2555] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:07 2022] DELETE /identity/v3/users/28f5c864464549dda40c99c2d7e37908 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:28:08.060402 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:08.060605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:08.060892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:08.080358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:08.081558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:08.144326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1283/2556] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:08.154137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:08.155745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:08.215540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d119c7-028f-4191-8b82-c10a2db2988b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:08.219229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:08.219870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:08.220146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:08.220426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:08.229554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:08.231024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:08.241472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1274/2557] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:08.513675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:08.515494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:08.530109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30283fbb-167b-4aab-b4ea-bffbc1ab6471 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:08.535155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:08.536251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:08.536531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:08.536828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] PATH_INFO: `/v3/projects/9151270d18314c04a55d2382c89e2601` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:08.538760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9151270d18314c04a55d2382c89e2601)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:08.540725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:08.582954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:08.591588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9151270d18314c04a55d2382c89e2601', 'request_id': 'req-f5ba0a4a-9331-4626-a4d9-718dbb81efed'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.599196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9151270d18314c04a55d2382c89e2601', 'request_id': 'req-f5ba0a4a-9331-4626-a4d9-718dbb81efed'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.605446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9151270d18314c04a55d2382c89e2601', 'request_id': 'req-f5ba0a4a-9331-4626-a4d9-718dbb81efed'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.617331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] The token cache is being invalidate because project 9151270d18314c04a55d2382c89e2601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:08.617618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.618270 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.619776 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1284/2558] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:08 2022] DELETE /identity/v3/projects/9151270d18314c04a55d2382c89e2601 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:08.623870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:08.633363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d14d-70f1-4314-b3b5-7207cc8a8d05 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:08.687974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:08.688586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:08.688864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:08.689133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] PATH_INFO: `/v3/users/88ab8b10147c4ac5920a3381c8b41f70` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:08.690234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ab8b10147c4ac5920a3381c8b41f70)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:08.692188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:08.736518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ab8b10147c4ac5920a3381c8b41f70'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.745271 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ab8b10147c4ac5920a3381c8b41f70'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.758132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ab8b10147c4ac5920a3381c8b41f70'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.758807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ab8b10147c4ac5920a3381c8b41f70'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.759440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8b6ff03e-283a-4402-865e-40193c7cfa98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ab8b10147c4ac5920a3381c8b41f70'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:08.772483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1275/2559] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:08 2022] DELETE /identity/v3/users/88ab8b10147c4ac5920a3381c8b41f70 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:09.035103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.036582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:09.052835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba0a4a-9331-4626-a4d9-718dbb81efed admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.110443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.111061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.111332 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.111630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] PATH_INFO: `/v3/projects/f27e1934edcf4a79829d8515598ca1d4` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.112721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27e1934edcf4a79829d8515598ca1d4)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.114619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.159856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27e1934edcf4a79829d8515598ca1d4', 'request_id': 'req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:09.167123 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27e1934edcf4a79829d8515598ca1d4', 'request_id': 'req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:09.172576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27e1934edcf4a79829d8515598ca1d4', 'request_id': 'req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:09.183592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] The token cache is being invalidate because project f27e1934edcf4a79829d8515598ca1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:09.183878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:09.184507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-1e3da1e3-2b1d-4adc-80b1-5a38140e1e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:09.185987 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1285/2560] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:09 2022] DELETE /identity/v3/projects/f27e1934edcf4a79829d8515598ca1d4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:09.191002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0184-2b8b-46ec-b595-2b57b460c6f1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.191512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0184-2b8b-46ec-b595-2b57b460c6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.191611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0184-2b8b-46ec-b595-2b57b460c6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.199654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:09.214513 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6c4e0184-2b8b-46ec-b595-2b57b460c6f1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:09.215774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6c4e0184-2b8b-46ec-b595-2b57b460c6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:09.274885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1276/2561] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:09.282800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512674-5937-4674-a7a6-24c4bf287bfc None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.283085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512674-5937-4674-a7a6-24c4bf287bfc None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.283355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512674-5937-4674-a7a6-24c4bf287bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.303007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e7512674-5937-4674-a7a6-24c4bf287bfc None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:09.304250 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e7512674-5937-4674-a7a6-24c4bf287bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:09.312505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1286/2562] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:09.321653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0184-2b8b-46ec-b595-2b57b460c6f1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.331202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0184-2b8b-46ec-b595-2b57b460c6f1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.336315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.336904 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.337177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.337442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.338108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:28:09.338404 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.340027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.354772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1277/2563] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:28:09.356174 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512674-5937-4674-a7a6-24c4bf287bfc None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.365931 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512674-5937-4674-a7a6-24c4bf287bfc None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.371121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.371890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.372171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.372661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.373394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.376200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.407301 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1287/2564] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:09.411648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.421598 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3574b-2aba-4635-beea-df2dbc65103c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.477409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.478009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.478319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.478597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.479222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.481190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.502956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1278/2565] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:09.507317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.517486 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f997a1e-bbd8-4582-86eb-f49c4737e3c0 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.522149 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.522749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.523038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.523304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.523976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.525704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.535967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1288/2566] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:09.540254 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.550347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98657b1-699d-45b1-90a6-9b12a014a727 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.555530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635b646-e897-4894-9600-114627675952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.556124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b646-e897-4894-9600-114627675952 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.556402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b646-e897-4894-9600-114627675952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.556674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b646-e897-4894-9600-114627675952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.557313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635b646-e897-4894-9600-114627675952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.558918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635b646-e897-4894-9600-114627675952 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.571158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1279/2567] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:09.575212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.585215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050177d-f0fd-4205-98ba-847bfeec3b50 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.589946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.590579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.590851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.591138 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] PATH_INFO: `/v3/projects/69bff7fe815d440c9a657bdb5a805732/users/6d3fd885c8d94619bb7e3ee0f38abbfe/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.605558 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bff7fe815d440c9a657bdb5a805732, user_id=6d3fd885c8d94619bb7e3ee0f38abbfe, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.608510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.611603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:09.624284 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1289/2568] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:09 2022] PUT /identity/v3/projects/69bff7fe815d440c9a657bdb5a805732/users/6d3fd885c8d94619bb7e3ee0f38abbfe/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:09.636143 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992bfb-20ac-4b71-9ad9-e198c1d2c59c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.636431 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992bfb-20ac-4b71-9ad9-e198c1d2c59c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.636709 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992bfb-20ac-4b71-9ad9-e198c1d2c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.664902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-76992bfb-20ac-4b71-9ad9-e198c1d2c59c None None] MFA Rules not processed for user `6d3fd885c8d94619bb7e3ee0f38abbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:09.666066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-76992bfb-20ac-4b71-9ad9-e198c1d2c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:09.726620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:09.733135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1280/2569] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:09.737063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.801083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea13858-76ea-42c3-ba5c-8ffa23146819 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.806268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dedff-a492-4d58-9d51-6bf59a33cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.806873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dedff-a492-4d58-9d51-6bf59a33cbbe admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.807153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dedff-a492-4d58-9d51-6bf59a33cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.807455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dedff-a492-4d58-9d51-6bf59a33cbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.808094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dedff-a492-4d58-9d51-6bf59a33cbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.810008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dedff-a492-4d58-9d51-6bf59a33cbbe admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.839440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1290/2570] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:09.843283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992bfb-20ac-4b71-9ad9-e198c1d2c59c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.853863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992bfb-20ac-4b71-9ad9-e198c1d2c59c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.901102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.901389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.901664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.913714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.914320 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.914599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.914869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.915727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.917906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.922667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:09.923908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:09.940775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1281/2571] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:09.944772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.954367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c110c-019a-43c8-81d2-042861e16f6d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.959022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.959634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.959908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:09.960174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:09.960802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:09.962373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:09.972065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1282/2572] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:28:09.976582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.982263 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1291/2573] 10.222.0.18 () {58 vars in 967 bytes} [Tue Sep 6 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:09.986555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d78b4-b43d-4e6f-a142-a3dc1148ffd1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:09.996578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:09.997948 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:09.998632 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:09.999293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:09.999714 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.000302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] PATH_INFO: `/v3/projects/8db7805e5daa4532bf76ea846dac62ab/users/3f0df9d23869481fafb52c15aa4c3d12/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:10.015317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db7805e5daa4532bf76ea846dac62ab, user_id=3f0df9d23869481fafb52c15aa4c3d12, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:10.018027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:10.031019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1283/2574] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:09 2022] PUT /identity/v3/projects/8db7805e5daa4532bf76ea846dac62ab/users/3f0df9d23869481fafb52c15aa4c3d12/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:28:10.034928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:10.070125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bd72a-db07-4bdb-97fa-be978f8c72bd None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:10.096292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:10.099349 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92202d54-6870-48a1-a847-2f95981284bf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:10.104897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:10.105501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:10.105798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.106049 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:10.106693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:10.108598 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:10.119174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1284/2575] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:28:10.123348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:10.133078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7d21-6688-448a-a210-0a53760be3af admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:10.133216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:10.133793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:10.134074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.134346 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:10.137850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a52cd-31e2-479a-9bad-e0666f0b1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:10.138658 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a52cd-31e2-479a-9bad-e0666f0b1b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:10.138937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a52cd-31e2-479a-9bad-e0666f0b1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.139734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a52cd-31e2-479a-9bad-e0666f0b1b09 admin admin] PATH_INFO: `/v3/projects/8db7805e5daa4532bf76ea846dac62ab/users/3f0df9d23869481fafb52c15aa4c3d12/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:10.142402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a52cd-31e2-479a-9bad-e0666f0b1b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db7805e5daa4532bf76ea846dac62ab, user_id=3f0df9d23869481fafb52c15aa4c3d12, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:10.145144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a52cd-31e2-479a-9bad-e0666f0b1b09 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:10.155227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1285/2576] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:10 2022] PUT /identity/v3/projects/8db7805e5daa4532bf76ea846dac62ab/users/3f0df9d23869481fafb52c15aa4c3d12/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:28:10.165928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a36f6-edb3-4e2a-8ed4-68c8e0c4df9e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:10.166230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a36f6-edb3-4e2a-8ed4-68c8e0c4df9e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.166600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a36f6-edb3-4e2a-8ed4-68c8e0c4df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:10.190480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:10.192128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:10.195350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-543a36f6-edb3-4e2a-8ed4-68c8e0c4df9e None None] MFA Rules not processed for user `3f0df9d23869481fafb52c15aa4c3d12`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:10.196590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-543a36f6-edb3-4e2a-8ed4-68c8e0c4df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:10.201133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1292/2577] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:28:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 04:28:10.221705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:10.268785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1286/2578] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:10.280891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:10.282298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:10.347227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e240d-7a55-4945-ade9-6cc871880696 service swift] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:10.401062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d879d2c-8a1c-41d7-9cba-55ec5dfd7f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:10.401698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d879d2c-8a1c-41d7-9cba-55ec5dfd7f75 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:10.401979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d879d2c-8a1c-41d7-9cba-55ec5dfd7f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.402286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d879d2c-8a1c-41d7-9cba-55ec5dfd7f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:10.411840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d879d2c-8a1c-41d7-9cba-55ec5dfd7f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:10.413962 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d879d2c-8a1c-41d7-9cba-55ec5dfd7f75 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:10.425727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1293/2579] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:10.824041 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a36f6-edb3-4e2a-8ed4-68c8e0c4df9e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:10.886761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a36f6-edb3-4e2a-8ed4-68c8e0c4df9e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:10.891228 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:10.891913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:10.892183 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.892448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] PATH_INFO: `/v3/users/6d3fd885c8d94619bb7e3ee0f38abbfe` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:10.893829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3fd885c8d94619bb7e3ee0f38abbfe)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:10.895495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:10.943782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3fd885c8d94619bb7e3ee0f38abbfe'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:10.950784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3fd885c8d94619bb7e3ee0f38abbfe'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:10.967017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3fd885c8d94619bb7e3ee0f38abbfe'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:10.967861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3fd885c8d94619bb7e3ee0f38abbfe'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:10.968549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3fd885c8d94619bb7e3ee0f38abbfe'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:10.981700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1287/2580] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:10 2022] DELETE /identity/v3/users/6d3fd885c8d94619bb7e3ee0f38abbfe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:10.986287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:10.986764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:10.986861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:11.006440 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:11.007681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:11.031547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:11.066612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1294/2581] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:11.076353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:11.077754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:11.121311 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:11.137093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0bb0-f313-4436-b413-1d3ad800391e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:11.140664 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:11.141255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:11.141530 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:11.141826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:11.151069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:11.152510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:11.161600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1288/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:11.427819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:11.429657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:11.441966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dd718-f20f-4797-a342-8b13e90e5974 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:11.447085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:11.447749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:11.448032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:11.448305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] PATH_INFO: `/v3/projects/69bff7fe815d440c9a657bdb5a805732` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:11.449491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bff7fe815d440c9a657bdb5a805732)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:11.451353 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:11.498640 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bff7fe815d440c9a657bdb5a805732', 'request_id': 'req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.506262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bff7fe815d440c9a657bdb5a805732', 'request_id': 'req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.512409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bff7fe815d440c9a657bdb5a805732', 'request_id': 'req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.523654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] The token cache is being invalidate because project 69bff7fe815d440c9a657bdb5a805732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:11.523938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.524561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.526036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1295/2583] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:11 2022] DELETE /identity/v3/projects/69bff7fe815d440c9a657bdb5a805732 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:11.529994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:11.539786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0884cd7-68b6-40ac-8025-86a0d20b5cc9 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:11.594567 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:11.595186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:11.595496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:11.595768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] PATH_INFO: `/v3/users/3f0df9d23869481fafb52c15aa4c3d12` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:11.596864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0df9d23869481fafb52c15aa4c3d12)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:11.598770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:11.644494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0df9d23869481fafb52c15aa4c3d12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.651278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0df9d23869481fafb52c15aa4c3d12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.663397 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0df9d23869481fafb52c15aa4c3d12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.664073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0df9d23869481fafb52c15aa4c3d12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.664676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-60b97362-1022-4a54-a6c2-cb8dd2f436f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0df9d23869481fafb52c15aa4c3d12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:11.676647 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1289/2584] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:11 2022] DELETE /identity/v3/users/3f0df9d23869481fafb52c15aa4c3d12 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:11.949306 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:11.950870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:11.966584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8af21a-cf37-4bf1-87af-ddf65becc6f3 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.026062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.026645 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.026871 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.027162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] PATH_INFO: `/v3/projects/8db7805e5daa4532bf76ea846dac62ab` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.028292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db7805e5daa4532bf76ea846dac62ab)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.030188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.078572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db7805e5daa4532bf76ea846dac62ab', 'request_id': 'req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:12.082148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:12.086565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db7805e5daa4532bf76ea846dac62ab', 'request_id': 'req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:12.093251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db7805e5daa4532bf76ea846dac62ab', 'request_id': 'req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:12.104139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] The token cache is being invalidate because project 8db7805e5daa4532bf76ea846dac62ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:12.104422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:12.105046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b42db8-3ad5-4f41-a53e-15d0ced9f14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:12.106504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1296/2585] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:11 2022] DELETE /identity/v3/projects/8db7805e5daa4532bf76ea846dac62ab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:12.111711 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba58ab7-9fdf-469a-8a28-c799f7e9665d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.112083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba58ab7-9fdf-469a-8a28-c799f7e9665d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.112439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba58ab7-9fdf-469a-8a28-c799f7e9665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.132820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0ba58ab7-9fdf-469a-8a28-c799f7e9665d None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:12.134007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0ba58ab7-9fdf-469a-8a28-c799f7e9665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:12.192188 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1290/2586] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:12.201516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942a74a-5ae5-4f85-8a16-375aac0f7b52 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.201800 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942a74a-5ae5-4f85-8a16-375aac0f7b52 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.202073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942a74a-5ae5-4f85-8a16-375aac0f7b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.222745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2942a74a-5ae5-4f85-8a16-375aac0f7b52 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:12.223967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2942a74a-5ae5-4f85-8a16-375aac0f7b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:12.231698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1297/2587] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:12.236182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba58ab7-9fdf-469a-8a28-c799f7e9665d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.241084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:12.247300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba58ab7-9fdf-469a-8a28-c799f7e9665d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.252974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.253614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.253888 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.254160 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.254796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:28:12.255094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.257255 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.268839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1291/2588] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:28:12.273739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942a74a-5ae5-4f85-8a16-375aac0f7b52 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.282890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942a74a-5ae5-4f85-8a16-375aac0f7b52 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.287488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.288074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.288349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.288616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.289247 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.291137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.317577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1298/2589] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:12 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:12.322083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.332121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535747b-9b3a-4f4b-bfaf-4229fbb038cf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.388194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.388785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.389063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.389332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.389964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.391941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.412790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1292/2590] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:12 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:12.417037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.427234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a84dc-8e27-49ad-a0d5-cd28ddc7f328 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.437921 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.439641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.439641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.439641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.440245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.441858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.453864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1299/2591] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:12.457914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.468403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ce80-6df4-4ae8-b42c-84de51214eac admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.473435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d3db0-b95d-484b-af61-e74a5b627e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.474006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3db0-b95d-484b-af61-e74a5b627e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.474006 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3db0-b95d-484b-af61-e74a5b627e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.474195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3db0-b95d-484b-af61-e74a5b627e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.474776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d3db0-b95d-484b-af61-e74a5b627e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.476651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d3db0-b95d-484b-af61-e74a5b627e3e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.488091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1293/2592] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:12.492623 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.502799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1c99d-5eec-4254-92ee-2e3f463b05ad admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.508176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.508819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.509121 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.509422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] PATH_INFO: `/v3/projects/e7002aea956f440e83d4854186ea7f49/users/8a19937f38e442c8bc07926cebed2987/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.523787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7002aea956f440e83d4854186ea7f49, user_id=8a19937f38e442c8bc07926cebed2987, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.526422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.539001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1300/2593] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:12 2022] PUT /identity/v3/projects/e7002aea956f440e83d4854186ea7f49/users/8a19937f38e442c8bc07926cebed2987/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:12.548974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113c13-94fc-47b6-bcc9-26ecf08ed4e6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.549440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113c13-94fc-47b6-bcc9-26ecf08ed4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.549553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113c13-94fc-47b6-bcc9-26ecf08ed4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.577698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-88113c13-94fc-47b6-bcc9-26ecf08ed4e6 None None] MFA Rules not processed for user `8a19937f38e442c8bc07926cebed2987`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:12.578919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-88113c13-94fc-47b6-bcc9-26ecf08ed4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:12.641944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1294/2594] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:12.646370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.705851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fb9aa-7621-494a-a29b-2d6a75a0ee03 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.710464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.711049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.711325 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.711626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.712254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.714155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.742350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1301/2595] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:12 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:12.746364 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113c13-94fc-47b6-bcc9-26ecf08ed4e6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.758230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113c13-94fc-47b6-bcc9-26ecf08ed4e6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.816676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:12.823858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.824473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.824928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.825226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.825913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.827993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.848708 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1295/2596] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:12 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:12.852303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.862579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f47f6a-bbc0-4c6f-91e5-ac4612de5232 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.867594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.868456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.868735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.868999 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.869626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.871217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.882375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1302/2597] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:12.886291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.896084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7c097-2f75-477a-9059-3d842d61449b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.900727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:12.901357 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:12.901630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:12.901899 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] PATH_INFO: `/v3/projects/021be249bc6748279ed060848c9da665/users/5155e83e9ebe4902998490b2e1e4a4c4/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:12.917010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] RBAC: Authorizing `identity:create_grant(project_id=021be249bc6748279ed060848c9da665, user_id=5155e83e9ebe4902998490b2e1e4a4c4, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:12.919683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:12.932640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1296/2598] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:12 2022] PUT /identity/v3/projects/021be249bc6748279ed060848c9da665/users/5155e83e9ebe4902998490b2e1e4a4c4/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:12.936704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:12.946533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d151ac-db78-4e67-8e8e-9944173f0d04 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:12.993993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:13.004497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bdcec-190d-4d2a-b554-a1e12e449ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:13.005105 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bdcec-190d-4d2a-b554-a1e12e449ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.005381 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bdcec-190d-4d2a-b554-a1e12e449ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.005654 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bdcec-190d-4d2a-b554-a1e12e449ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:13.006321 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bdcec-190d-4d2a-b554-a1e12e449ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:13.007952 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bdcec-190d-4d2a-b554-a1e12e449ba2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:13.017943 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1303/2599] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:13.022212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:13.032295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16c70-3746-4417-bfc5-8086d34d562a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:13.037324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:13.037949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.038219 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.038481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] PATH_INFO: `/v3/projects/021be249bc6748279ed060848c9da665/users/5155e83e9ebe4902998490b2e1e4a4c4/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:13.040420 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=021be249bc6748279ed060848c9da665, user_id=5155e83e9ebe4902998490b2e1e4a4c4, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:13.043032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:13.053801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1297/2600] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:13 2022] PUT /identity/v3/projects/021be249bc6748279ed060848c9da665/users/5155e83e9ebe4902998490b2e1e4a4c4/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:13.064033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d636a5-1e12-41e2-9862-c0e348931215 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.064498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d636a5-1e12-41e2-9862-c0e348931215 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.064591 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d636a5-1e12-41e2-9862-c0e348931215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:13.096576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-08d636a5-1e12-41e2-9862-c0e348931215 None None] MFA Rules not processed for user `5155e83e9ebe4902998490b2e1e4a4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:13.097698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-08d636a5-1e12-41e2-9862-c0e348931215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:13.168090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1304/2601] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:13.180747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:13.182477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:13.238793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec9f4e-f367-47c3-857a-b29a00f24c8c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:13.242954 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:13.243578 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.243854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.244118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:13.252801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:13.254204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:13.263441 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1298/2602] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:13.352442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d636a5-1e12-41e2-9862-c0e348931215 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:13.362405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d636a5-1e12-41e2-9862-c0e348931215 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:13.366028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a29ab-28df-48da-8caf-58794bc87f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:13.366612 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a29ab-28df-48da-8caf-58794bc87f57 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.366890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a29ab-28df-48da-8caf-58794bc87f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.367154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a29ab-28df-48da-8caf-58794bc87f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:13.423388 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a29ab-28df-48da-8caf-58794bc87f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:13.424825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a29ab-28df-48da-8caf-58794bc87f57 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:13.433714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1305/2603] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:13.690278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:13.751144 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335e251-19e8-4d28-bec8-86bcb2e70e34 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:13.756414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:13.757033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.757307 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.757577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] PATH_INFO: `/v3/users/8a19937f38e442c8bc07926cebed2987` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:13.758692 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a19937f38e442c8bc07926cebed2987)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:13.760661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:13.805400 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a19937f38e442c8bc07926cebed2987'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:13.810764 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:13.813268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a19937f38e442c8bc07926cebed2987'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:13.827348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a19937f38e442c8bc07926cebed2987'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:13.828081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a19937f38e442c8bc07926cebed2987'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:13.828693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a19937f38e442c8bc07926cebed2987'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:13.841574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1299/2604] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:13 2022] DELETE /identity/v3/users/8a19937f38e442c8bc07926cebed2987 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:13.846100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.846387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.846664 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:13.865543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:13.866674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:13.923705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1306/2605] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:13.933165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:13.934569 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:13.991994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ebeb-3257-4547-9e3d-cd7f8d83c2e5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:13.996203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:13.996825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:13.997096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:13.997372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:14.007663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:14.009005 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:14.018374 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1300/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:14.275308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:14.276830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:14.289322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb248ff-ae7c-479a-81e9-8c4583a2ec74 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:14.293964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:14.294607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:14.294873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:14.295145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] PATH_INFO: `/v3/projects/e7002aea956f440e83d4854186ea7f49` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:14.296295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7002aea956f440e83d4854186ea7f49)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:14.298221 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:14.307169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:14.346522 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7002aea956f440e83d4854186ea7f49', 'request_id': 'req-5f4b6c28-2189-4dbd-841b-da653bd06dea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.353739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7002aea956f440e83d4854186ea7f49', 'request_id': 'req-5f4b6c28-2189-4dbd-841b-da653bd06dea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.359679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7002aea956f440e83d4854186ea7f49', 'request_id': 'req-5f4b6c28-2189-4dbd-841b-da653bd06dea'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.370809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] The token cache is being invalidate because project e7002aea956f440e83d4854186ea7f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:14.371090 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.371728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.373181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1307/2607] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:14 2022] DELETE /identity/v3/projects/e7002aea956f440e83d4854186ea7f49 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:14.377171 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:14.387099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79535-cb1d-43b8-a303-8b09275ec17d service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:14.443705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:14.444332 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:14.444606 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:14.444875 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] PATH_INFO: `/v3/users/5155e83e9ebe4902998490b2e1e4a4c4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:14.446026 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5155e83e9ebe4902998490b2e1e4a4c4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:14.447990 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:14.491625 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5155e83e9ebe4902998490b2e1e4a4c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.498590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5155e83e9ebe4902998490b2e1e4a4c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.512572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5155e83e9ebe4902998490b2e1e4a4c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.513240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5155e83e9ebe4902998490b2e1e4a4c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.513860 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-483ec7a0-bd05-48e3-adad-234b53ed1e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5155e83e9ebe4902998490b2e1e4a4c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.516398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:14.527477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1301/2608] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:14 2022] DELETE /identity/v3/users/5155e83e9ebe4902998490b2e1e4a4c4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:14.805518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:14.806946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:14.820242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6c28-2189-4dbd-841b-da653bd06dea admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:14.884035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:14.884602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:14.884875 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:14.885139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] PATH_INFO: `/v3/projects/021be249bc6748279ed060848c9da665` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:14.886252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021be249bc6748279ed060848c9da665)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:14.888178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:14.934099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021be249bc6748279ed060848c9da665', 'request_id': 'req-21b6bbfd-995c-4221-a75d-77b658f89981'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.940835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021be249bc6748279ed060848c9da665', 'request_id': 'req-21b6bbfd-995c-4221-a75d-77b658f89981'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.946232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021be249bc6748279ed060848c9da665', 'request_id': 'req-21b6bbfd-995c-4221-a75d-77b658f89981'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.957021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] The token cache is being invalidate because project 021be249bc6748279ed060848c9da665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:14.957302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.957927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-21b6bbfd-995c-4221-a75d-77b658f89981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:14.959944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1308/2609] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:14 2022] DELETE /identity/v3/projects/021be249bc6748279ed060848c9da665 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:14.964759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd6382-2311-43ea-bedc-a865d162798c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:14.965235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd6382-2311-43ea-bedc-a865d162798c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:14.965350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd6382-2311-43ea-bedc-a865d162798c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:14.985577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d8cd6382-2311-43ea-bedc-a865d162798c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:14.986794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d8cd6382-2311-43ea-bedc-a865d162798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:15.050522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1302/2610] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:15.058550 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1a54-b230-49e4-baaa-c08251d98fc4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.058853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1a54-b230-49e4-baaa-c08251d98fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.059119 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1a54-b230-49e4-baaa-c08251d98fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.078383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-454e1a54-b230-49e4-baaa-c08251d98fc4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:15.079611 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-454e1a54-b230-49e4-baaa-c08251d98fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:15.087851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1309/2611] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:15.091808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd6382-2311-43ea-bedc-a865d162798c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:15.101793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd6382-2311-43ea-bedc-a865d162798c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:15.106536 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:15.107133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.107697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.107971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.108617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:28:15.108915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:15.110516 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:15.122184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1303/2612] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 04:28:15.126275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e1a54-b230-49e4-baaa-c08251d98fc4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:15.136262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e1a54-b230-49e4-baaa-c08251d98fc4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:15.140769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:15.141348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.141623 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.141889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.142516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:15.144450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:15.164791 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:15.173855 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1310/2613] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:15 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:28:15.177859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:15.187902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aab2a-7b75-4082-8fc8-dbc7d9efcee3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:15.244106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:15.244697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.244971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.245238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.245863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:15.247835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:15.270048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1304/2614] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:15 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:15.274603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:15.287697 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa5f2-7bd5-450f-8ccf-8c97baae1e84 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:15.292283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:15.292873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.293146 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.293411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.294044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:15.295703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:15.305495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1311/2615] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:15.309461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:15.320108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a92e-3dc3-45fb-934b-0faf6dbd3deb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:15.324730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d4d0f-2164-41d7-90d9-5bf29719fe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:15.325322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4d0f-2164-41d7-90d9-5bf29719fe3a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.325601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4d0f-2164-41d7-90d9-5bf29719fe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.326169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4d0f-2164-41d7-90d9-5bf29719fe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.326814 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d4d0f-2164-41d7-90d9-5bf29719fe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:15.328457 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d4d0f-2164-41d7-90d9-5bf29719fe3a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:15.339858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1305/2616] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:15.344008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:15.353914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709574-13cf-47ad-afd1-de4d0b9991b3 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:15.358753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:15.359398 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.359698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.359971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] PATH_INFO: `/v3/projects/b395c93b5a374d65aaf52431414f91ae/users/bf2a49c90b514082936521668347fe17/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.374113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b395c93b5a374d65aaf52431414f91ae, user_id=bf2a49c90b514082936521668347fe17, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:15.376812 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:15.389920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1312/2617] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:15 2022] PUT /identity/v3/projects/b395c93b5a374d65aaf52431414f91ae/users/bf2a49c90b514082936521668347fe17/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:15.400511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92911-baa0-4f14-9b27-523ded44839a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.400796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92911-baa0-4f14-9b27-523ded44839a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.401070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92911-baa0-4f14-9b27-523ded44839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.429108 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bca92911-baa0-4f14-9b27-523ded44839a None None] MFA Rules not processed for user `bf2a49c90b514082936521668347fe17`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:15.430612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bca92911-baa0-4f14-9b27-523ded44839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:15.476473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:15.496337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1306/2618] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:15.507672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:15.509411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:15.564616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d320-8a39-4c8e-8194-875e5c4d804d admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:15.568816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:15.569412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:15.569688 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:15.569954 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:15.577991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:15.579437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:15.588066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1313/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:23.260368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8304-24a0-4bd4-bf94-11bfe9a6092b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:23.260882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8304-24a0-4bd4-bf94-11bfe9a6092b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:23.260982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8304-24a0-4bd4-bf94-11bfe9a6092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:23.280231 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-871e8304-24a0-4bd4-bf94-11bfe9a6092b None None] MFA Rules not processed for user `eb9a096eb0524a62919110a6f863351d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:23.281421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-871e8304-24a0-4bd4-bf94-11bfe9a6092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:23.336365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1307/2620] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:23.657037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:23.658584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:23.718877 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c433f-f0f2-4e24-a166-58db1aa6d09e service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:23.722474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d97c94-194a-496e-8f39-fe04567b133c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:23.723065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d97c94-194a-496e-8f39-fe04567b133c service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:23.723342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d97c94-194a-496e-8f39-fe04567b133c service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:23.724237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d97c94-194a-496e-8f39-fe04567b133c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:23.725941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-89d97c94-194a-496e-8f39-fe04567b133c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:23.735659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d97c94-194a-496e-8f39-fe04567b133c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:23.737079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d97c94-194a-496e-8f39-fe04567b133c service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:23.745634 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1314/2621] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:25.655145 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8304-24a0-4bd4-bf94-11bfe9a6092b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:25.717925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8304-24a0-4bd4-bf94-11bfe9a6092b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:25.722475 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:25.723096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:25.723393 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:25.723686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] PATH_INFO: `/v3/users/bf2a49c90b514082936521668347fe17` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:25.724793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2a49c90b514082936521668347fe17)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:25.726697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:25.774218 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2a49c90b514082936521668347fe17'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:25.781491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2a49c90b514082936521668347fe17'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:25.794503 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2a49c90b514082936521668347fe17'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:25.795215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2a49c90b514082936521668347fe17'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:25.795850 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2a49c90b514082936521668347fe17'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:25.810178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1308/2622] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:25 2022] DELETE /identity/v3/users/bf2a49c90b514082936521668347fe17 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:25.814704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:25.815209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:25.815209 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:25.834754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:25.835997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:25.899768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1315/2623] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:25.905639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:25.907137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:25.922590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:25.987127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fcee4-e327-45aa-952f-703c6526e87e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:25.998373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204eba6-e6e5-4d58-b7e4-cbd7e7b87b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:25.999013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204eba6-e6e5-4d58-b7e4-cbd7e7b87b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:25.999290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204eba6-e6e5-4d58-b7e4-cbd7e7b87b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:25.999590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204eba6-e6e5-4d58-b7e4-cbd7e7b87b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.012577 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204eba6-e6e5-4d58-b7e4-cbd7e7b87b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.014322 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204eba6-e6e5-4d58-b7e4-cbd7e7b87b3d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.025468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1309/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:26.316033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.318405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:26.341941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b57635-3123-4b19-aa13-87cebe4ec05f None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.350801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.352484 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.352774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.353047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] PATH_INFO: `/v3/projects/b395c93b5a374d65aaf52431414f91ae` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.354511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b395c93b5a374d65aaf52431414f91ae)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.356498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.359453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:26.407390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b395c93b5a374d65aaf52431414f91ae', 'request_id': 'req-800230f2-47d5-4a05-80ff-8909a2faa74e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:26.415901 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b395c93b5a374d65aaf52431414f91ae', 'request_id': 'req-800230f2-47d5-4a05-80ff-8909a2faa74e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:26.422394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b395c93b5a374d65aaf52431414f91ae', 'request_id': 'req-800230f2-47d5-4a05-80ff-8909a2faa74e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:26.436062 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] The token cache is being invalidate because project b395c93b5a374d65aaf52431414f91ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:26.436569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:26.437168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-800230f2-47d5-4a05-80ff-8909a2faa74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:26.439603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1316/2625] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:26 2022] DELETE /identity/v3/projects/b395c93b5a374d65aaf52431414f91ae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:26.444640 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70474-279e-48cd-926b-a5d562f8df9c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.444925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70474-279e-48cd-926b-a5d562f8df9c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.445198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70474-279e-48cd-926b-a5d562f8df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.465533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-51f70474-279e-48cd-926b-a5d562f8df9c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:26.466766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-51f70474-279e-48cd-926b-a5d562f8df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:26.532181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1310/2626] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:26.600050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af20fb-6dcb-4283-9b3f-ea96bb9ec792 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.600248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af20fb-6dcb-4283-9b3f-ea96bb9ec792 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.600515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af20fb-6dcb-4283-9b3f-ea96bb9ec792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.620538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-96af20fb-6dcb-4283-9b3f-ea96bb9ec792 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:26.621744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-96af20fb-6dcb-4283-9b3f-ea96bb9ec792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:26.630092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1317/2627] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:26.634347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70474-279e-48cd-926b-a5d562f8df9c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.643966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70474-279e-48cd-926b-a5d562f8df9c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.649037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.649650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.649925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.650192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.650856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:28:26.651154 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.652776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.664534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1311/2628] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:28:26.668621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af20fb-6dcb-4283-9b3f-ea96bb9ec792 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.677963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af20fb-6dcb-4283-9b3f-ea96bb9ec792 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.682593 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.683189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.683502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.683774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.684403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.686315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.714925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1318/2629] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:26 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:26.718955 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.728760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a77a8-550d-43f1-9fa5-2122c5abd84e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.789365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.790017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.790458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.790740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.791417 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.793630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.802851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.804843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:26.823684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1312/2630] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:26 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:26.825166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.836079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890db1-7d34-4258-b676-c057ef1dc949 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.841355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.842043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.842329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.842667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.843518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.845212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.866787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1313/2631] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:26.868724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.880705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6a7a7-cb87-4fb4-be9f-71bd361278ef admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.887153 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.888355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.888651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.888929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.889588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.891892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.898566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1532f-21ea-4682-a371-4754d4826232 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.903976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1314/2632] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:28:26.907840 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:26.908154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f3042-34e4-4773-a4a9-7c30c7f450cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.908770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3042-34e4-4773-a4a9-7c30c7f450cb service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.909047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3042-34e4-4773-a4a9-7c30c7f450cb service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.909314 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3042-34e4-4773-a4a9-7c30c7f450cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.911170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-eb6f3042-34e4-4773-a4a9-7c30c7f450cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:26.918745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb0153-e9e1-4e5c-b9f3-b51a3187e61f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:26.924662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f3042-34e4-4773-a4a9-7c30c7f450cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.925230 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:26.925948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.926309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.927088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f3042-34e4-4773-a4a9-7c30c7f450cb service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.927197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] PATH_INFO: `/v3/projects/64d9df03aad34f84815ae287ad439f3e/users/5042a155e4184cf29801d66370ec9b93/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.937003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:26.939663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1319/2633] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:26.945650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d9df03aad34f84815ae287ad439f3e, user_id=5042a155e4184cf29801d66370ec9b93, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:26.949667 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:26.965812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1315/2634] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:26 2022] PUT /identity/v3/projects/64d9df03aad34f84815ae287ad439f3e/users/5042a155e4184cf29801d66370ec9b93/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:28:26.971262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed48f-3acf-498d-9790-f9ee5db00c82 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:26.971485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed48f-3acf-498d-9790-f9ee5db00c82 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:26.971714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed48f-3acf-498d-9790-f9ee5db00c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:26.992823 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-3f5ed48f-3acf-498d-9790-f9ee5db00c82 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:26.994548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-3f5ed48f-3acf-498d-9790-f9ee5db00c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:27.043241 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:27.062202 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1320/2635] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:27.072561 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:27.074355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:27.132541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e84470-2a68-4ba4-adf5-a0b98dc9ed27 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:27.136308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:27.136923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:27.137201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:27.137473 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:27.146683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:27.148162 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:27.157839 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1316/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:32.393893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570731-cc0a-4930-bd1c-a2474552be45 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:32.396118 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570731-cc0a-4930-bd1c-a2474552be45 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:32.396400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570731-cc0a-4930-bd1c-a2474552be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:32.426691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7a570731-cc0a-4930-bd1c-a2474552be45 None None] MFA Rules not processed for user `5042a155e4184cf29801d66370ec9b93`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:32.427949 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7a570731-cc0a-4930-bd1c-a2474552be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:32.512375 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1321/2637] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:32.516851 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:32.527504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577584-5781-4706-bd4a-04178c134f58 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:32.532190 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:32.532827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:32.533106 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:32.533377 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:32.534024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:32.536017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:32.563325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1317/2638] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:32 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:28:32.567963 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570731-cc0a-4930-bd1c-a2474552be45 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:32.579031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570731-cc0a-4930-bd1c-a2474552be45 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:32.637735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:32.638424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:32.638701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:32.638974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:32.639656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:32.642584 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:32.665472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1322/2639] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:32 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:32.669679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:32.680402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d29e2b-cc8e-4fe3-955d-fce17b9507fa admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:32.685137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:32.685829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:32.686173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:32.686509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:32.687221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:32.688928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:32.701060 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1318/2640] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:28:32.705137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:32.716072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a10ff-a5d0-4097-b006-18267c60fb23 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:32.720824 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:32.721488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:32.721764 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:32.722034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] PATH_INFO: `/v3/projects/1e67d50a584745138fe026bb23778e3c/users/9db444b533984de0b9d94f8fc09fe4e1/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:32.738186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e67d50a584745138fe026bb23778e3c, user_id=9db444b533984de0b9d94f8fc09fe4e1, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:32.741663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:32.755971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1323/2641] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:32 2022] PUT /identity/v3/projects/1e67d50a584745138fe026bb23778e3c/users/9db444b533984de0b9d94f8fc09fe4e1/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:32.760176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:32.770359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c277-c334-4a8c-bab6-8d843728374d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:32.831438 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b9608-021c-4124-b053-f5bf578e5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:32.832051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b9608-021c-4124-b053-f5bf578e5ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:32.832358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b9608-021c-4124-b053-f5bf578e5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:32.832630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b9608-021c-4124-b053-f5bf578e5ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:32.833276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b9608-021c-4124-b053-f5bf578e5ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:32.834902 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b9608-021c-4124-b053-f5bf578e5ab9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:32.847437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1319/2642] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:32.850437 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:32.861798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba15ef-e43f-47dc-ad2f-c64930ecab45 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:32.868058 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:32.868662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:32.868937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:32.869312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] PATH_INFO: `/v3/projects/1e67d50a584745138fe026bb23778e3c/users/9db444b533984de0b9d94f8fc09fe4e1/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:32.871912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e67d50a584745138fe026bb23778e3c, user_id=9db444b533984de0b9d94f8fc09fe4e1, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:32.874592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:32.890396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1324/2643] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:32 2022] PUT /identity/v3/projects/1e67d50a584745138fe026bb23778e3c/users/9db444b533984de0b9d94f8fc09fe4e1/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:38.758088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f70a-87cf-4c1a-ab02-628df5527336 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:38.758634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f70a-87cf-4c1a-ab02-628df5527336 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:38.758634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f70a-87cf-4c1a-ab02-628df5527336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:38.787509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-55d4f70a-87cf-4c1a-ab02-628df5527336 None None] MFA Rules not processed for user `9db444b533984de0b9d94f8fc09fe4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:38.788730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-55d4f70a-87cf-4c1a-ab02-628df5527336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:38.840529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:38.872089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1320/2644] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:38.886364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:38.889412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:38.938158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:38.964354 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f19b9f-306c-40fd-8b70-ea8a12e43494 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:38.967922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:38.968536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:38.968803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:38.969067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:39.040063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:39.041851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:39.052741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1325/2645] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:39.220427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e1b3c-a02b-4301-8882-a757707fc791 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:39.220700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e1b3c-a02b-4301-8882-a757707fc791 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:39.220976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e1b3c-a02b-4301-8882-a757707fc791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:39.245360 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-798e1b3c-a02b-4301-8882-a757707fc791 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:39.246591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-798e1b3c-a02b-4301-8882-a757707fc791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:39.310275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1321/2646] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:28:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:39.346077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:39.347592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:39.426224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79183f-2c97-44e9-a59d-ec4450072771 service glance] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:39.432923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dad45-8877-4f77-9e89-69c95516b3d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:39.433604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dad45-8877-4f77-9e89-69c95516b3d4 service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:39.433993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dad45-8877-4f77-9e89-69c95516b3d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:39.435338 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dad45-8877-4f77-9e89-69c95516b3d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:39.444735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dad45-8877-4f77-9e89-69c95516b3d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:39.446403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dad45-8877-4f77-9e89-69c95516b3d4 service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:39.455106 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1326/2647] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:28:47.931793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca181ab-e3a9-4278-b4e4-6cc7a871b356 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:47.932308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca181ab-e3a9-4278-b4e4-6cc7a871b356 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:47.932611 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca181ab-e3a9-4278-b4e4-6cc7a871b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:47.955185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6ca181ab-e3a9-4278-b4e4-6cc7a871b356 None None] MFA Rules not processed for user `5042a155e4184cf29801d66370ec9b93`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:47.956482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6ca181ab-e3a9-4278-b4e4-6cc7a871b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:47.969829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1322/2648] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:49.451680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=66 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:50.114356 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ba56-2cf3-44cb-ae6f-41c212bf2ab2 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:50.114637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ba56-2cf3-44cb-ae6f-41c212bf2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:50.115130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ba56-2cf3-44cb-ae6f-41c212bf2ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:50.135501 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c555ba56-2cf3-44cb-ae6f-41c212bf2ab2 None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:50.136994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c555ba56-2cf3-44cb-ae6f-41c212bf2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:50.146518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1327/2649] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Sep 6 04:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:50.162077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca181ab-e3a9-4278-b4e4-6cc7a871b356 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:50.175276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca181ab-e3a9-4278-b4e4-6cc7a871b356 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:50.181553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:50.182527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:50.182991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:50.183480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:50.193584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:50.195893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:50.212007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1323/2650] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:28:52.633352 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ba56-2cf3-44cb-ae6f-41c212bf2ab2 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:52.802860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ba56-2cf3-44cb-ae6f-41c212bf2ab2 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:52.810646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:52.811587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:52.812183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:52.812610 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:52.815204 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:52.843151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:52.845847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:52.890468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1328/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:53.027963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:53.030215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:53.150775 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb55c-8009-40a8-9a22-46b102a1db32 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:53.157363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:53.158201 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:53.158778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:53.159599 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:53.170683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:53.314700 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:53.316237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:53.332291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1324/2652] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:57.625435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:57.627599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:57.695085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:57.697693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:57.713761 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4b470-128b-49c9-a720-84708ca90026 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:57.725605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1caf7f-3b34-4f51-b2c3-0177243376e5 service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:57.731672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:57.731888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:57.732447 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:57.732726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:57.732995 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:57.733290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:57.733747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:57.734960 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] PATH_INFO: `/v3/users/f8f46235d0d34ba5bbb60e675002fc6e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:57.735173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:57.737346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f46235d0d34ba5bbb60e675002fc6e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:57.740096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:57.766415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:57.779144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:57.781124 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:57.794056 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1329/2653] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:28:57.844844 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f46235d0d34ba5bbb60e675002fc6e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:57.852693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f46235d0d34ba5bbb60e675002fc6e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:57.869122 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f46235d0d34ba5bbb60e675002fc6e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:57.869884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f46235d0d34ba5bbb60e675002fc6e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:57.870512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5339ce7a-fcf5-40f1-a447-3d5732cef1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f46235d0d34ba5bbb60e675002fc6e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:57.890424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1325/2654] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:28:57 2022] DELETE /identity/v3/users/f8f46235d0d34ba5bbb60e675002fc6e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:58.083414 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.097144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce1531-25ae-4182-bfbd-3c1b46a32f58 service placement] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.175970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.176615 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.176971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.177155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] PATH_INFO: `/v3/projects/31d315b079404c0fb4554135d315def6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.178405 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d315b079404c0fb4554135d315def6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.180481 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.197927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:58.242594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d315b079404c0fb4554135d315def6', 'request_id': 'req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:58.250920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d315b079404c0fb4554135d315def6', 'request_id': 'req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:58.257376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d315b079404c0fb4554135d315def6', 'request_id': 'req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:58.269397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] The token cache is being invalidate because project 31d315b079404c0fb4554135d315def6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:28:58.269687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:58.270366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f878e8b8-daca-44bd-a36b-9f7b1d5ac69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:28:58.272038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1330/2655] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:28:58 2022] DELETE /identity/v3/projects/31d315b079404c0fb4554135d315def6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:58.276979 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626e411-273b-496c-a236-c8352677a59c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.277262 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626e411-273b-496c-a236-c8352677a59c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.277531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626e411-273b-496c-a236-c8352677a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.300543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1626e411-273b-496c-a236-c8352677a59c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:58.301859 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1626e411-273b-496c-a236-c8352677a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:58.363525 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1326/2656] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:58.372187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ee30-259c-46cd-b961-7b8df132b3b9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.372459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ee30-259c-46cd-b961-7b8df132b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.372734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ee30-259c-46cd-b961-7b8df132b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.392363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-8ef8ee30-259c-46cd-b961-7b8df132b3b9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:58.394023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8ef8ee30-259c-46cd-b961-7b8df132b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:58.401882 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1331/2657] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:28:58.406111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626e411-273b-496c-a236-c8352677a59c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.416410 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626e411-273b-496c-a236-c8352677a59c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.420999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.421588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.421864 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.422131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.422774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:28:58.423111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.424733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.436580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1327/2658] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:28:58.440759 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ee30-259c-46cd-b961-7b8df132b3b9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.449809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ee30-259c-46cd-b961-7b8df132b3b9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.454434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.455017 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.455292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.456135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.456761 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.458661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.488756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1332/2659] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:58 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:58.492937 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.504853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78465c-9c9b-4448-80d8-71afb2ca50f1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.560848 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.561452 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.561727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.561993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.562609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.564572 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.587932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1328/2660] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:58 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:58.592084 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.603257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c3cf-dc99-4027-bdb5-8d552d87c03a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.608374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.608968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.609248 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.609521 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.610179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.611817 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.621802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1333/2661] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:58.625604 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.631121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:58.637885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a60d6-76a3-4bb6-86d1-de7908eba244 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.644187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ddc0f-6bc9-44c4-9b04-99b2caf101fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.644817 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ddc0f-6bc9-44c4-9b04-99b2caf101fc admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.645099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ddc0f-6bc9-44c4-9b04-99b2caf101fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.645367 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ddc0f-6bc9-44c4-9b04-99b2caf101fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.646013 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ddc0f-6bc9-44c4-9b04-99b2caf101fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.647661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ddc0f-6bc9-44c4-9b04-99b2caf101fc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.659974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1329/2662] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:58.662914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.673132 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d2cd-7d51-4cf0-9e92-3fd385d33d43 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.677816 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.678455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.678733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.679007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] PATH_INFO: `/v3/projects/cfe39c59d5ed42ebb1f3a991c857f27e/users/1ca007c99d874b5d83b559a5536e5102/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.694814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe39c59d5ed42ebb1f3a991c857f27e, user_id=1ca007c99d874b5d83b559a5536e5102, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.697540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.712902 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1334/2663] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:58 2022] PUT /identity/v3/projects/cfe39c59d5ed42ebb1f3a991c857f27e/users/1ca007c99d874b5d83b559a5536e5102/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:58.723135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4e83e-8a08-48d1-a62e-1eb141f757e0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.723693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4e83e-8a08-48d1-a62e-1eb141f757e0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.723693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4e83e-8a08-48d1-a62e-1eb141f757e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.757576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-24e4e83e-8a08-48d1-a62e-1eb141f757e0 None None] MFA Rules not processed for user `1ca007c99d874b5d83b559a5536e5102`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:58.758834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-24e4e83e-8a08-48d1-a62e-1eb141f757e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:58.828317 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1330/2664] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:58.833404 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.906185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329a65f-35e6-49be-ad73-220df36f0c33 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:58.912049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:58.912682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:58.912959 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:58.913228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:58.913941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:58.915839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:58.948447 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1335/2665] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:28:58 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:58.949867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4e83e-8a08-48d1-a62e-1eb141f757e0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:58.961735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4e83e-8a08-48d1-a62e-1eb141f757e0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:59.028068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:59.028696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:59.028969 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:59.029234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:59.029852 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:59.031785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:59.054203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1331/2666] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:28:58 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:28:59.058266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:59.069436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe3a03-9193-4d8a-b882-517c22f8387f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:59.074411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:59.075162 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:59.075471 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:59.075862 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:59.076509 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:59.078128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:59.089320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1336/2667] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:59.093551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:59.104000 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2dbe-7992-4a13-870f-e873d5b9f448 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:59.109164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:59.109819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:59.110089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:59.110355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] PATH_INFO: `/v3/projects/08078142a0054b948331ddafb83341e4/users/47cabfea87a64ab881e0aef74d36c13c/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:59.126500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08078142a0054b948331ddafb83341e4, user_id=47cabfea87a64ab881e0aef74d36c13c, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:59.129804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:59.144100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1332/2668] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:59 2022] PUT /identity/v3/projects/08078142a0054b948331ddafb83341e4/users/47cabfea87a64ab881e0aef74d36c13c/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:59.148242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:59.158457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ddc18-1f9b-457e-ab3c-713d7abe7a4f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:59.164403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:59.228741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35c2c2-9f40-446d-9036-5cdd96486970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:59.229371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c2c2-9f40-446d-9036-5cdd96486970 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:59.229648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c2c2-9f40-446d-9036-5cdd96486970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:59.229919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c2c2-9f40-446d-9036-5cdd96486970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:59.230842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35c2c2-9f40-446d-9036-5cdd96486970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:59.232497 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35c2c2-9f40-446d-9036-5cdd96486970 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:59.243482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1337/2669] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:28:59.247363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:59.259752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5258-edae-487a-bcb4-9583dd182660 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:59.265313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:59.265975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:59.266252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:59.266543 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] PATH_INFO: `/v3/projects/08078142a0054b948331ddafb83341e4/users/47cabfea87a64ab881e0aef74d36c13c/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:59.268745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08078142a0054b948331ddafb83341e4, user_id=47cabfea87a64ab881e0aef74d36c13c, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:59.271486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:59.282845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1333/2670] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:28:59 2022] PUT /identity/v3/projects/08078142a0054b948331ddafb83341e4/users/47cabfea87a64ab881e0aef74d36c13c/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:28:59.294541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:59.294857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:59.295130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:59.324946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] MFA Rules not processed for user `47cabfea87a64ab881e0aef74d36c13c`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:28:59.326161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:59.408079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1338/2671] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:28:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:28:59.420278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:28:59.422014 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:28:59.461125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:59.494768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc99d-a428-46d8-97a3-4cb9d2afc244 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:28:59.498751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:28:59.500035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:28:59.500350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:28:59.500685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:28:59.581757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:28:59.583243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:28:59.592422 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1334/2672] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:28:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:02.162101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:02.163540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:02.175932 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27adfe-c8bb-405d-84dc-22335548471d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:02.179513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:02.180094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:02.180370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:02.180637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:02.189442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:02.191519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:02.201085 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1339/2673] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:04.235443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:04.236871 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:04.291965 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40143c-0874-49cf-b861-29bfa500aaf4 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:04.295538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:04.296142 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:04.296411 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:04.296663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:04.298352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:04.363132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:04.364652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:04.374527 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1335/2674] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:11.476175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:11.478586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:11.529309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:11.531117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:11.555870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a19c-7ea5-49b1-a50e-400d75ef5dc5 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:11.560883 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:11.561744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:11.562079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:11.562409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] PATH_INFO: `/v3/users/e576df45bde048aea99a010e5f3919e7` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:11.563642 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e576df45bde048aea99a010e5f3919e7)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:11.566168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:11.601672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc30e19-8bc6-4ed0-8353-d80406837e1c service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:11.607256 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:11.608120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:11.608365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:11.608740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:11.609359 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:11.623586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:11.623880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e576df45bde048aea99a010e5f3919e7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:11.624956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:11.626891 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:11.634922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e576df45bde048aea99a010e5f3919e7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:11.638010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1340/2675] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:11.651050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e576df45bde048aea99a010e5f3919e7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:11.652030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e576df45bde048aea99a010e5f3919e7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:11.655813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e576df45bde048aea99a010e5f3919e7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:11.671358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1336/2676] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:11 2022] DELETE /identity/v3/users/e576df45bde048aea99a010e5f3919e7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:29:11.850600 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:11.862410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97d57-da0a-476e-bdb9-1e1693348027 service placement] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:11.866307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:11.932899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:11.933523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:11.933798 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:11.934065 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] PATH_INFO: `/v3/projects/616dd8caeaa545c7968b714ec4bf14e2` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:11.935218 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616dd8caeaa545c7968b714ec4bf14e2)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:11.937253 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:11.990537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616dd8caeaa545c7968b714ec4bf14e2', 'request_id': 'req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:11.999638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616dd8caeaa545c7968b714ec4bf14e2', 'request_id': 'req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.007680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616dd8caeaa545c7968b714ec4bf14e2', 'request_id': 'req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.020647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] The token cache is being invalidate because project 616dd8caeaa545c7968b714ec4bf14e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:12.020939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.021711 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.023446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1341/2677] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:11 2022] DELETE /identity/v3/projects/616dd8caeaa545c7968b714ec4bf14e2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:12.027505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:12.029002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:12.043612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ae41-400c-490e-b2cd-4acd79184c92 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:12.123538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:12.124173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:12.124491 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:12.124796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] PATH_INFO: `/v3/users/0d8af6a2c7894e41bd1843efd8f9cdf8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:12.126321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8af6a2c7894e41bd1843efd8f9cdf8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:12.128528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:12.182910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8af6a2c7894e41bd1843efd8f9cdf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.190138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8af6a2c7894e41bd1843efd8f9cdf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.203276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8af6a2c7894e41bd1843efd8f9cdf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.204077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8af6a2c7894e41bd1843efd8f9cdf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.204789 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8af6a2c7894e41bd1843efd8f9cdf8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.222585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1337/2678] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:12 2022] DELETE /identity/v3/users/0d8af6a2c7894e41bd1843efd8f9cdf8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:12.400274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:12.401703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:12.415474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59974fa7-fd5e-4a2e-b928-45a70eb95fe5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:12.478777 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:12.479545 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:12.479719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:12.479989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] PATH_INFO: `/v3/projects/2d56cb52a1e64faca63264cc90768da6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:12.481389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d56cb52a1e64faca63264cc90768da6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:12.483303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:12.522602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:12.531060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d56cb52a1e64faca63264cc90768da6', 'request_id': 'req-b076b707-9a79-4611-a37f-cf52c4491a92'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.540934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d56cb52a1e64faca63264cc90768da6', 'request_id': 'req-b076b707-9a79-4611-a37f-cf52c4491a92'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.546434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d56cb52a1e64faca63264cc90768da6', 'request_id': 'req-b076b707-9a79-4611-a37f-cf52c4491a92'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.558605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] The token cache is being invalidate because project 2d56cb52a1e64faca63264cc90768da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:12.558897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.559571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:12.561052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1342/2679] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:12 2022] DELETE /identity/v3/projects/2d56cb52a1e64faca63264cc90768da6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:14.540586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:14.542132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:14.588675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:14.616238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516d8a-9c0f-4966-a620-352e33c16295 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:14.669213 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41480fd-1c7b-432e-b403-2fd8b3d59d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:14.670052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41480fd-1c7b-432e-b403-2fd8b3d59d84 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:14.670402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41480fd-1c7b-432e-b403-2fd8b3d59d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:14.670741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41480fd-1c7b-432e-b403-2fd8b3d59d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:14.672650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a41480fd-1c7b-432e-b403-2fd8b3d59d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:14.740911 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41480fd-1c7b-432e-b403-2fd8b3d59d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:14.742345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41480fd-1c7b-432e-b403-2fd8b3d59d84 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:14.752668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1338/2680] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:29:15.214780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:15.216237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:15.281787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076b707-9a79-4611-a37f-cf52c4491a92 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:15.291687 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:15.293701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:15.293983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:15.294309 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] PATH_INFO: `/v3/users/1ca007c99d874b5d83b559a5536e5102` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:15.295903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca007c99d874b5d83b559a5536e5102)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:15.297705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:15.347293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca007c99d874b5d83b559a5536e5102'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.355582 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca007c99d874b5d83b559a5536e5102'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.368050 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca007c99d874b5d83b559a5536e5102'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.368788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca007c99d874b5d83b559a5536e5102'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.369382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca007c99d874b5d83b559a5536e5102'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.382246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1343/2681] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:15 2022] DELETE /identity/v3/users/1ca007c99d874b5d83b559a5536e5102 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:15.386930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:15.387807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:15.387807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:15.407999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:15.409675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:15.471815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1339/2682] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:15.481779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:15.483254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:15.537988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:15.545758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814701c4-9e39-4105-93dc-75bd1b5664d2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:15.550539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:15.551703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:15.552342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:15.553039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:15.563069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:15.564618 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:15.574382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1344/2683] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:15.852099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:15.853582 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:15.868314 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76492d37-d40a-4c5c-bf20-4191fb70430f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:15.872984 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:15.873622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:15.873897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:15.874166 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] PATH_INFO: `/v3/projects/cfe39c59d5ed42ebb1f3a991c857f27e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:15.875861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe39c59d5ed42ebb1f3a991c857f27e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:15.878731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:15.921929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:15.937192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe39c59d5ed42ebb1f3a991c857f27e', 'request_id': 'req-25d978d6-b62e-462e-b8f8-843a5af2e8d0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.946903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe39c59d5ed42ebb1f3a991c857f27e', 'request_id': 'req-25d978d6-b62e-462e-b8f8-843a5af2e8d0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.956669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe39c59d5ed42ebb1f3a991c857f27e', 'request_id': 'req-25d978d6-b62e-462e-b8f8-843a5af2e8d0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.967739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] The token cache is being invalidate because project cfe39c59d5ed42ebb1f3a991c857f27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:15.968027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.968681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:15.970169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1340/2684] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:15 2022] DELETE /identity/v3/projects/cfe39c59d5ed42ebb1f3a991c857f27e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:15.974281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:15.987616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be889-8dbe-4c0b-bfd5-5e60c60e026c service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:16.057683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:16.058312 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:16.058594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:16.058868 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] PATH_INFO: `/v3/users/47cabfea87a64ab881e0aef74d36c13c` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:16.060000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cabfea87a64ab881e0aef74d36c13c)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:16.061925 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:16.112237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cabfea87a64ab881e0aef74d36c13c'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.119511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cabfea87a64ab881e0aef74d36c13c'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.132581 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cabfea87a64ab881e0aef74d36c13c'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.133310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cabfea87a64ab881e0aef74d36c13c'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.133990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-bd17ed35-3745-4a95-9da5-9d15ab49c230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cabfea87a64ab881e0aef74d36c13c'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.148893 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1345/2685] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:15 2022] DELETE /identity/v3/users/47cabfea87a64ab881e0aef74d36c13c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:16.421596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:16.423120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:16.440691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d978d6-b62e-462e-b8f8-843a5af2e8d0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:16.502425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:16.503175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:16.503495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:16.503770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] PATH_INFO: `/v3/projects/08078142a0054b948331ddafb83341e4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:16.504935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08078142a0054b948331ddafb83341e4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:16.506863 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:16.557305 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08078142a0054b948331ddafb83341e4', 'request_id': 'req-5bd59527-1225-4362-b548-d589e3333a08'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.565594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08078142a0054b948331ddafb83341e4', 'request_id': 'req-5bd59527-1225-4362-b548-d589e3333a08'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.571912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08078142a0054b948331ddafb83341e4', 'request_id': 'req-5bd59527-1225-4362-b548-d589e3333a08'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.584639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] The token cache is being invalidate because project 08078142a0054b948331ddafb83341e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:16.584932 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.585605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5bd59527-1225-4362-b548-d589e3333a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:16.587329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1341/2686] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:16 2022] DELETE /identity/v3/projects/08078142a0054b948331ddafb83341e4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:16.592185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d439b-29ba-4052-8be1-5b1ff66dfcb9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:16.592714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d439b-29ba-4052-8be1-5b1ff66dfcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:16.592714 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d439b-29ba-4052-8be1-5b1ff66dfcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:16.614061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-6c9d439b-29ba-4052-8be1-5b1ff66dfcb9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:16.615453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-6c9d439b-29ba-4052-8be1-5b1ff66dfcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:16.685503 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1346/2687] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:29:16.693486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fcae-3037-4b71-91f1-993bb1f4d3da None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:16.693845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fcae-3037-4b71-91f1-993bb1f4d3da None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:16.694185 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fcae-3037-4b71-91f1-993bb1f4d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:16.715092 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b390fcae-3037-4b71-91f1-993bb1f4d3da None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:16.716465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b390fcae-3037-4b71-91f1-993bb1f4d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:16.724655 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1342/2688] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:16.728989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d439b-29ba-4052-8be1-5b1ff66dfcb9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:16.739852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d439b-29ba-4052-8be1-5b1ff66dfcb9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:16.746322 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:16.746937 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:16.747219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:16.747535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:16.748186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:29:16.748826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:16.750110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:16.753574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:16.765139 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1347/2689] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:29:16.770881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390fcae-3037-4b71-91f1-993bb1f4d3da None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:16.785189 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390fcae-3037-4b71-91f1-993bb1f4d3da None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:16.792705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:16.792929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:16.793260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:16.793541 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:16.794235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:16.796933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:16.835415 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1343/2690] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:16 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:16.838787 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:16.853474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383c35-9884-4950-ac3b-ea1a478a7738 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:16.943693 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:16.944313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:16.944590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:16.944861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:16.945972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:16.948889 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:16.980299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1348/2691] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:16 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:29:16.981973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.001551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc782ef-ca0d-402b-8d3c-98c5cccea0f4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.007130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.008365 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.008650 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.008923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.009586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.013731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.029389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1344/2692] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:17.031417 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.049914 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9cbda-326c-4200-99c1-b62180b75017 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.055660 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b016-fd77-4631-9cb4-7703c8be13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.056335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b016-fd77-4631-9cb4-7703c8be13fa admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.056727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b016-fd77-4631-9cb4-7703c8be13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.057093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b016-fd77-4631-9cb4-7703c8be13fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.057884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0b016-fd77-4631-9cb4-7703c8be13fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.060254 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0b016-fd77-4631-9cb4-7703c8be13fa admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.077286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1349/2693] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:17.078637 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.091670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a9976-d8fe-4e63-ae3f-a2309b1871ad admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.098619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.099727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.099987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.100555 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] PATH_INFO: `/v3/projects/7baa4876065742e7bf35219b10a5ade9/users/d8f014565c5d4231954d4f832a2c4b05/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.104866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:17.121070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7baa4876065742e7bf35219b10a5ade9, user_id=d8f014565c5d4231954d4f832a2c4b05, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.125357 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.157102 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1345/2694] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:17 2022] PUT /identity/v3/projects/7baa4876065742e7bf35219b10a5ade9/users/d8f014565c5d4231954d4f832a2c4b05/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:17.159200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290639ed-ef1b-49b7-a248-b68a8e900e08 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.159331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290639ed-ef1b-49b7-a248-b68a8e900e08 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.159859 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290639ed-ef1b-49b7-a248-b68a8e900e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.205802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-290639ed-ef1b-49b7-a248-b68a8e900e08 None None] MFA Rules not processed for user `d8f014565c5d4231954d4f832a2c4b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:17.207746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-290639ed-ef1b-49b7-a248-b68a8e900e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:17.339420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1350/2695] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:17.343782 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.444493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14668-c915-43cf-b68b-cb573907f6d8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.450379 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.451090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.451421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.451697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.452430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.454558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.503009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1346/2696] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:17 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:17.504259 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290639ed-ef1b-49b7-a248-b68a8e900e08 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.522781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290639ed-ef1b-49b7-a248-b68a8e900e08 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.606603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.607935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.608216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.608489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.609213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.611595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.643561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:17.657038 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1351/2697] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:17 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:17.661266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.677158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ec10c-cf8f-4507-a496-44e9ee63176d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.684313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.685274 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.686229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.686666 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.687510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.690943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.720520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1347/2698] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:17.721580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.735649 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a9a9-1479-48cc-b5ca-da25493da651 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.748781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.749590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.751064 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.751436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] PATH_INFO: `/v3/projects/6da350e4098e4c709c855035e9681dd8/users/06495ec8ae12481f9cc518c3edcacdf1/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.776775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da350e4098e4c709c855035e9681dd8, user_id=06495ec8ae12481f9cc518c3edcacdf1, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.780140 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.804455 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.810793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1352/2699] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:17 2022] PUT /identity/v3/projects/6da350e4098e4c709c855035e9681dd8/users/06495ec8ae12481f9cc518c3edcacdf1/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:29:17.818173 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b055d-88fd-456f-8687-fbfae33d15d7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.904037 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94765-b32b-4610-9eed-f85d9c32e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.905141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94765-b32b-4610-9eed-f85d9c32e0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.905534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94765-b32b-4610-9eed-f85d9c32e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.905906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94765-b32b-4610-9eed-f85d9c32e0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.906821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94765-b32b-4610-9eed-f85d9c32e0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.909429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94765-b32b-4610-9eed-f85d9c32e0dd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.924677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1348/2700] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:17.930153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:17.947908 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69cc2-5d6f-49d8-bb1e-8b528e1f4d3e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:17.956340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:17.957286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:17.957881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:17.958317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] PATH_INFO: `/v3/projects/6da350e4098e4c709c855035e9681dd8/users/06495ec8ae12481f9cc518c3edcacdf1/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:17.961223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da350e4098e4c709c855035e9681dd8, user_id=06495ec8ae12481f9cc518c3edcacdf1, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:17.967037 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:17.996340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1353/2701] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:17 2022] PUT /identity/v3/projects/6da350e4098e4c709c855035e9681dd8/users/06495ec8ae12481f9cc518c3edcacdf1/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:29:18.015008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4c17-bda0-4b05-9f93-2624584dc319 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:18.015989 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4c17-bda0-4b05-9f93-2624584dc319 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:18.016576 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4c17-bda0-4b05-9f93-2624584dc319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:18.051687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-88db4c17-bda0-4b05-9f93-2624584dc319 None None] MFA Rules not processed for user `06495ec8ae12481f9cc518c3edcacdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:18.052940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-88db4c17-bda0-4b05-9f93-2624584dc319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:18.131081 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:18.212309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1349/2702] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:18.226232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:18.228358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:18.355234 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8d5a-338e-45e8-a3aa-2644ddd583b6 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:18.373532 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:18.374182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:18.374459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:18.374731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:18.402548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:18.404193 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:18.433669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1354/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:18.857325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db4c17-bda0-4b05-9f93-2624584dc319 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:18.867987 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db4c17-bda0-4b05-9f93-2624584dc319 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:18.873601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06495ec8ae12481f9cc518c3edcacdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da350e4098e4c709c855035e9681dd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:18.874212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:18.874487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:18.874753 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:18.875421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:29:18.875772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:18.879324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:18.894528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1350/2704] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:29:18.898385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:18.915673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ba98-3c0e-447b-ab5c-cb565308c7dd service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:18.931547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06495ec8ae12481f9cc518c3edcacdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da350e4098e4c709c855035e9681dd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:18.932362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:18.932979 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:18.933570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:18.934472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:18.936801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:18.972730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1355/2705] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:18 2022] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:18.976862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:18.994643 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4249cd-5eb5-4b96-99ef-7362e6497412 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:19.118778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06495ec8ae12481f9cc518c3edcacdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da350e4098e4c709c855035e9681dd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:19.120178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:19.121406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:19.122007 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:19.122847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:29:19.123326 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:19.125896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:19.146845 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1351/2706] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:29:19.196046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:19.214348 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d58f46-675f-4637-b8cf-38f4eaf7e747 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:19.220744 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06495ec8ae12481f9cc518c3edcacdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da350e4098e4c709c855035e9681dd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:19.221602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:19.222391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:19.223287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] PATH_INFO: `/v3/projects/7c981c63cd74498a8d3005764b5228b1` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:19.225396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c981c63cd74498a8d3005764b5228b1)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:19.228488 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:19.310203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c981c63cd74498a8d3005764b5228b1', 'request_id': 'req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.324475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c981c63cd74498a8d3005764b5228b1', 'request_id': 'req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.334459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c981c63cd74498a8d3005764b5228b1', 'request_id': 'req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.351758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] The token cache is being invalidate because project 7c981c63cd74498a8d3005764b5228b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:19.352368 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.353463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-436846b1-a6b0-4ee2-a5e3-0ee6e92f1bcc tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.356981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1356/2707] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:19 2022] DELETE /identity/v3/projects/7c981c63cd74498a8d3005764b5228b1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:19.643193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:19.645069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:19.735778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c62a2-d51f-415f-8129-0326c7b5e2c2 tempest-VolumeQuotaClassesTest-417378409 tempest-VolumeQuotaClassesTest-417378409-project-admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:19.807238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:19.807992 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:19.808341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:19.808694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] PATH_INFO: `/v3/users/d8f014565c5d4231954d4f832a2c4b05` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:19.809928 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f014565c5d4231954d4f832a2c4b05)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:19.812356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:19.825853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:19.880715 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f014565c5d4231954d4f832a2c4b05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.888539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f014565c5d4231954d4f832a2c4b05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.901199 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f014565c5d4231954d4f832a2c4b05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.902444 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f014565c5d4231954d4f832a2c4b05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.903226 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f014565c5d4231954d4f832a2c4b05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:19.920482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1352/2708] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:19 2022] DELETE /identity/v3/users/d8f014565c5d4231954d4f832a2c4b05 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:19.925548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:19.926007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:19.926102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:19.945596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:19.946844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:19.960659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:20.016430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1357/2709] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:20.027033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:20.028517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:20.101131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf487-7270-4b9e-a85f-b0d8a06643da admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:20.105858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:20.106663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:20.106941 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:20.107425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:20.117807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:20.119301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:20.128944 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1353/2710] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:20.578001 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:20.579567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:20.605357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bc735-7298-4e15-96de-a9bfe46bfd1a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:20.610168 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:20.610806 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:20.611116 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:20.611432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] PATH_INFO: `/v3/projects/7baa4876065742e7bf35219b10a5ade9` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:20.613465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7baa4876065742e7bf35219b10a5ade9)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:20.615535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:20.666182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7baa4876065742e7bf35219b10a5ade9', 'request_id': 'req-95f941af-d151-4891-b51e-86bb0e1e8c75'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.674539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7baa4876065742e7bf35219b10a5ade9', 'request_id': 'req-95f941af-d151-4891-b51e-86bb0e1e8c75'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.680724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7baa4876065742e7bf35219b10a5ade9', 'request_id': 'req-95f941af-d151-4891-b51e-86bb0e1e8c75'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.692789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] The token cache is being invalidate because project 7baa4876065742e7bf35219b10a5ade9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:20.693098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.693748 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.695216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1358/2711] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:20 2022] DELETE /identity/v3/projects/7baa4876065742e7bf35219b10a5ade9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:20.699396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:20.709552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32349-fd17-4c2e-a2b6-37a1eddce059 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:20.773340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:20.774068 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:20.774355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:20.774631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] PATH_INFO: `/v3/users/06495ec8ae12481f9cc518c3edcacdf1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:20.775938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06495ec8ae12481f9cc518c3edcacdf1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:20.777891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:20.812459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:20.829344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06495ec8ae12481f9cc518c3edcacdf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.837198 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06495ec8ae12481f9cc518c3edcacdf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.852583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06495ec8ae12481f9cc518c3edcacdf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.853312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06495ec8ae12481f9cc518c3edcacdf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.854063 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2f5beb83-89ee-4a5d-9f0b-53e0332c765c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06495ec8ae12481f9cc518c3edcacdf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:20.871168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1354/2712] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:20 2022] DELETE /identity/v3/users/06495ec8ae12481f9cc518c3edcacdf1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:21.139803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.141277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:21.154192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f941af-d151-4891-b51e-86bb0e1e8c75 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.210991 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.211650 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.211923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.212188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] PATH_INFO: `/v3/projects/6da350e4098e4c709c855035e9681dd8` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.213275 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da350e4098e4c709c855035e9681dd8)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.215222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.260814 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:21.264310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da350e4098e4c709c855035e9681dd8', 'request_id': 'req-20a05303-7592-412e-b806-5cfa7a727227'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:21.271992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da350e4098e4c709c855035e9681dd8', 'request_id': 'req-20a05303-7592-412e-b806-5cfa7a727227'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:21.277641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da350e4098e4c709c855035e9681dd8', 'request_id': 'req-20a05303-7592-412e-b806-5cfa7a727227'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:21.289190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] The token cache is being invalidate because project 6da350e4098e4c709c855035e9681dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:21.289475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:21.290126 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-20a05303-7592-412e-b806-5cfa7a727227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:21.291671 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1359/2713] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:21 2022] DELETE /identity/v3/projects/6da350e4098e4c709c855035e9681dd8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:21.296507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498bf03-48b4-478f-adf7-7f76c1b0ccf1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.296999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498bf03-48b4-478f-adf7-7f76c1b0ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.297114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498bf03-48b4-478f-adf7-7f76c1b0ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.318104 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7498bf03-48b4-478f-adf7-7f76c1b0ccf1 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:21.319295 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7498bf03-48b4-478f-adf7-7f76c1b0ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:21.380039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1355/2714] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:29:21.388008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1879-cdd0-4d4f-a86a-abeee768ff46 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.388287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1879-cdd0-4d4f-a86a-abeee768ff46 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.388575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1879-cdd0-4d4f-a86a-abeee768ff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.409953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1aab1879-cdd0-4d4f-a86a-abeee768ff46 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:21.411148 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1aab1879-cdd0-4d4f-a86a-abeee768ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:21.419102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1360/2715] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:21.424132 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498bf03-48b4-478f-adf7-7f76c1b0ccf1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.433885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498bf03-48b4-478f-adf7-7f76c1b0ccf1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.441616 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.442300 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.442575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.442847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.443523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:29:21.443823 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.445409 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.458946 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1356/2716] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:29:21.463327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1879-cdd0-4d4f-a86a-abeee768ff46 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.473493 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1879-cdd0-4d4f-a86a-abeee768ff46 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.479326 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.480217 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.480492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.480903 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.481540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.483519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.515888 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1361/2717] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:21 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:21.518071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.528880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7a66-66c2-40c1-a183-cc9b2c06b9e9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.586843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.587494 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.587770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.588038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.588654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.590557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.613465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1357/2718] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:21 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:21.617635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.627760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b3e46-e6fd-47ef-a4fc-cb28947cf734 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.632324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.632916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.633189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.633454 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.634088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.635719 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.646390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1362/2719] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:21.650267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.660741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99dcb-efdb-488d-ad28-6d02216d9cb7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.665306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee73e-88e7-4233-bf4a-e9d13ce820da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.665884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee73e-88e7-4233-bf4a-e9d13ce820da admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.666157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee73e-88e7-4233-bf4a-e9d13ce820da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.666421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee73e-88e7-4233-bf4a-e9d13ce820da admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.667050 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee73e-88e7-4233-bf4a-e9d13ce820da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.668673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee73e-88e7-4233-bf4a-e9d13ce820da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.678970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1358/2720] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:21.682933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.692928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaacfb6-7f41-443f-b4f8-c80698ea7c03 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.697571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.698199 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.698473 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.698739 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] PATH_INFO: `/v3/projects/32cc392ae3ae40aaa71538e6c3313de2/users/923c7493673f45b7b795d1b4aaa5c98d/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.713335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32cc392ae3ae40aaa71538e6c3313de2, user_id=923c7493673f45b7b795d1b4aaa5c98d, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.716007 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.729518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1363/2721] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:21 2022] PUT /identity/v3/projects/32cc392ae3ae40aaa71538e6c3313de2/users/923c7493673f45b7b795d1b4aaa5c98d/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:21.741099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3896-ac56-4660-8a24-b7ddf30e387e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.741387 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3896-ac56-4660-8a24-b7ddf30e387e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.741661 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3896-ac56-4660-8a24-b7ddf30e387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.768964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-64ea3896-ac56-4660-8a24-b7ddf30e387e None None] MFA Rules not processed for user `923c7493673f45b7b795d1b4aaa5c98d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:21.770167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-64ea3896-ac56-4660-8a24-b7ddf30e387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:21.774071 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:21.835107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1359/2722] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:21.839734 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.900883 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6254-a45a-40be-b6c7-9e5299b8ab2e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:21.905423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:21.906023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:21.906297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:21.906566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:21.907203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:21.909150 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:21.938171 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1364/2723] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:21 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:21.942837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3896-ac56-4660-8a24-b7ddf30e387e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:21.953574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3896-ac56-4660-8a24-b7ddf30e387e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:22.014731 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:22.015313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.015628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.015897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.016532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:22.019105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:22.043443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1360/2724] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:21 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:29:22.045399 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:22.055677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c60e-e9a6-4f89-9888-b781269c6b52 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:22.060289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:22.060879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.061158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.061424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.062092 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:22.063665 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:22.074751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1365/2725] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:22.079105 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:22.090318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc0695-f2ee-4c24-afb4-c7a9c8b787f3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:22.095589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:22.096139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.096421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.096829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] PATH_INFO: `/v3/projects/670d79f4aa0846f69341653324fcdf2c/users/427e687d8ba147caa230ff4ea9fd20ee/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.112547 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=670d79f4aa0846f69341653324fcdf2c, user_id=427e687d8ba147caa230ff4ea9fd20ee, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:22.115897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:22.130403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1361/2726] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:22 2022] PUT /identity/v3/projects/670d79f4aa0846f69341653324fcdf2c/users/427e687d8ba147caa230ff4ea9fd20ee/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:22.134729 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:22.146898 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471d70-e6ba-4f04-b44f-df06e5eaede8 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:22.188833 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:22.209621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949c387-5993-4dac-b86c-41e7756455f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:22.210233 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949c387-5993-4dac-b86c-41e7756455f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.210512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949c387-5993-4dac-b86c-41e7756455f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.210784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949c387-5993-4dac-b86c-41e7756455f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.211461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949c387-5993-4dac-b86c-41e7756455f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:22.213098 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949c387-5993-4dac-b86c-41e7756455f2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:22.223192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1366/2727] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:22.227429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:22.238853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f42ad-426f-46b1-a7fa-d5ed74017d7c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:22.243804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:22.244453 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.244727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.244991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] PATH_INFO: `/v3/projects/670d79f4aa0846f69341653324fcdf2c/users/427e687d8ba147caa230ff4ea9fd20ee/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.246887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670d79f4aa0846f69341653324fcdf2c, user_id=427e687d8ba147caa230ff4ea9fd20ee, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:22.249549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:22.260853 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1362/2728] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:22 2022] PUT /identity/v3/projects/670d79f4aa0846f69341653324fcdf2c/users/427e687d8ba147caa230ff4ea9fd20ee/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:22.271117 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1980896-0baf-43b9-ba13-469ee2349af5 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.271422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1980896-0baf-43b9-ba13-469ee2349af5 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.271700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1980896-0baf-43b9-ba13-469ee2349af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.300095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a1980896-0baf-43b9-ba13-469ee2349af5 None None] MFA Rules not processed for user `427e687d8ba147caa230ff4ea9fd20ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:22.301315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a1980896-0baf-43b9-ba13-469ee2349af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:22.374321 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1367/2729] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:29:22.386059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:22.387822 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:22.446377 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a795a-bcee-4678-8f0f-4049ce9f7742 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:22.450113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:22.450716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.450996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.451269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.460297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:22.461720 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:22.466589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:22.471487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1363/2730] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:22.552425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1980896-0baf-43b9-ba13-469ee2349af5 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:22.562035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1980896-0baf-43b9-ba13-469ee2349af5 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:22.566380 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5255-7de8-434f-8bda-9c283178eae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:22.566973 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5255-7de8-434f-8bda-9c283178eae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:22.567245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5255-7de8-434f-8bda-9c283178eae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:22.567544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5255-7de8-434f-8bda-9c283178eae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:22.625101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5255-7de8-434f-8bda-9c283178eae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:22.626533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5255-7de8-434f-8bda-9c283178eae6 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:22.635303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1368/2731] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:27.495566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:27.560033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c070b3-1ead-4de3-be31-d9e8eb33c187 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:27.566019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:27.566663 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:27.566940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:27.567216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] PATH_INFO: `/v3/users/923c7493673f45b7b795d1b4aaa5c98d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:27.568515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=923c7493673f45b7b795d1b4aaa5c98d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:27.570347 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:27.615147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:27.615662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:27.615983 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:27.622882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923c7493673f45b7b795d1b4aaa5c98d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:27.630834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923c7493673f45b7b795d1b4aaa5c98d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:27.635423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] MFA Rules not processed for user `eb9a096eb0524a62919110a6f863351d`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:27.636799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:27.643424 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923c7493673f45b7b795d1b4aaa5c98d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:27.644090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923c7493673f45b7b795d1b4aaa5c98d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:27.644699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3ea464c4-5127-4931-8178-986a8b9e8b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923c7493673f45b7b795d1b4aaa5c98d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:27.657264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1364/2732] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:27 2022] DELETE /identity/v3/users/923c7493673f45b7b795d1b4aaa5c98d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:27.661575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:27.661866 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:27.662141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:27.682340 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:27.683612 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:27.693676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1369/2733] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:29:27.744020 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1365/2734] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:29:27.754460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:27.755864 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:27.766785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:27.814476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956747-43cf-4937-bb5f-642226b517ae None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:27.862919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:27.863560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:27.863835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:27.864102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:27.873163 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:27.874587 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:27.883917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1370/2735] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:28.320168 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:28.322030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:28.340730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c239448-ab6c-45a1-a641-64477a10a511 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:28.346919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:28.347654 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:28.348125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:28.348369 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] PATH_INFO: `/v3/projects/32cc392ae3ae40aaa71538e6c3313de2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:28.349649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32cc392ae3ae40aaa71538e6c3313de2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:28.351832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:28.369401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:28.402403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32cc392ae3ae40aaa71538e6c3313de2', 'request_id': 'req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.414380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32cc392ae3ae40aaa71538e6c3313de2', 'request_id': 'req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.417885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32cc392ae3ae40aaa71538e6c3313de2', 'request_id': 'req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.441856 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] The token cache is being invalidate because project 32cc392ae3ae40aaa71538e6c3313de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:28.442281 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.444323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.448402 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1366/2736] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:28 2022] DELETE /identity/v3/projects/32cc392ae3ae40aaa71538e6c3313de2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:28.449489 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:28.462194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0de44d-e0d4-473b-8851-e6cedd1d6055 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:28.530781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:28.531468 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:28.531701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:28.531992 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] PATH_INFO: `/v3/users/427e687d8ba147caa230ff4ea9fd20ee` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:28.533644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427e687d8ba147caa230ff4ea9fd20ee)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:28.535646 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:28.586692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427e687d8ba147caa230ff4ea9fd20ee'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.593607 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427e687d8ba147caa230ff4ea9fd20ee'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.604305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:28.607243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427e687d8ba147caa230ff4ea9fd20ee'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.608722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427e687d8ba147caa230ff4ea9fd20ee'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.609467 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-6daaace1-482f-4d23-9442-14ff675f97f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427e687d8ba147caa230ff4ea9fd20ee'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:28.623429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1371/2737] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:28 2022] DELETE /identity/v3/users/427e687d8ba147caa230ff4ea9fd20ee => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:28.896434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:28.897976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:28.911432 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48a8ca-2d9f-4b98-9fe6-b6d7c1f783c9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:28.978113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:28.978744 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:28.979021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:28.979292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] PATH_INFO: `/v3/projects/670d79f4aa0846f69341653324fcdf2c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:28.980686 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670d79f4aa0846f69341653324fcdf2c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:28.982580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.030923 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670d79f4aa0846f69341653324fcdf2c', 'request_id': 'req-7595d255-6ef9-4aa1-9e56-642f5df1eb89'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:29.038755 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670d79f4aa0846f69341653324fcdf2c', 'request_id': 'req-7595d255-6ef9-4aa1-9e56-642f5df1eb89'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:29.045323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670d79f4aa0846f69341653324fcdf2c', 'request_id': 'req-7595d255-6ef9-4aa1-9e56-642f5df1eb89'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:29.058478 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] The token cache is being invalidate because project 670d79f4aa0846f69341653324fcdf2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:29.058769 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:29.059467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7595d255-6ef9-4aa1-9e56-642f5df1eb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:29.061167 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1367/2738] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:28 2022] DELETE /identity/v3/projects/670d79f4aa0846f69341653324fcdf2c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:29.067560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611075a1-ae0f-47ed-ab3d-85afc598cf37 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.067843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611075a1-ae0f-47ed-ab3d-85afc598cf37 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.068111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611075a1-ae0f-47ed-ab3d-85afc598cf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.088894 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-611075a1-ae0f-47ed-ab3d-85afc598cf37 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:29.090100 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-611075a1-ae0f-47ed-ab3d-85afc598cf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:29.151978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1372/2739] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:29.160120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038d760-98a0-4c1c-a76d-183987d9bd88 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.160405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038d760-98a0-4c1c-a76d-183987d9bd88 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.160679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038d760-98a0-4c1c-a76d-183987d9bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.181676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3038d760-98a0-4c1c-a76d-183987d9bd88 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:29.191882 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3038d760-98a0-4c1c-a76d-183987d9bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:29.200165 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1368/2740] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:29.204613 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611075a1-ae0f-47ed-ab3d-85afc598cf37 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.214483 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611075a1-ae0f-47ed-ab3d-85afc598cf37 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.219127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.219770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.220049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.220315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.220953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81627) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:29:29.221252 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.222834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.234585 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1373/2741] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:29:29.239464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038d760-98a0-4c1c-a76d-183987d9bd88 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.248638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038d760-98a0-4c1c-a76d-183987d9bd88 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.253897 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.254511 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.254788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.255056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.255729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.257631 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.284095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1369/2742] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:29.288152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.298438 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e0960-03e4-493e-b715-2a0db0912518 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.356128 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.356733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.357012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.357282 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.357907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.359913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.387740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1374/2743] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:29.391924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.400203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:29.404004 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461490a-fa4d-4d33-9a50-10d14e443917 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.410784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.411581 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.412054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.412412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.413237 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.414833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.425749 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1370/2744] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:29.429531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.441251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69677-0109-4a68-bf35-5e49a5329234 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.446095 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6960-9237-4713-b4a5-e5a75d4adb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.446690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6960-9237-4713-b4a5-e5a75d4adb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.446969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6960-9237-4713-b4a5-e5a75d4adb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.447240 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6960-9237-4713-b4a5-e5a75d4adb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.447920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6960-9237-4713-b4a5-e5a75d4adb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.449529 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6960-9237-4713-b4a5-e5a75d4adb9e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.461872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1375/2745] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:29:29.466301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.477211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d116c-ead3-4447-87df-4b98d6b99ac9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.482111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.482751 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.483027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.483301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] PATH_INFO: `/v3/projects/467d97ccb9d4451cb77a5461472b9c50/users/352de2fe434b401fb5725743d7beb38d/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.498261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467d97ccb9d4451cb77a5461472b9c50, user_id=352de2fe434b401fb5725743d7beb38d, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.500994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.515622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1371/2746] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:29 2022] PUT /identity/v3/projects/467d97ccb9d4451cb77a5461472b9c50/users/352de2fe434b401fb5725743d7beb38d/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:29:29.527130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd4b25-f98c-47b2-8ec1-20c474719fb4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.527477 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd4b25-f98c-47b2-8ec1-20c474719fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.527784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd4b25-f98c-47b2-8ec1-20c474719fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.560291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0acd4b25-f98c-47b2-8ec1-20c474719fb4 None None] MFA Rules not processed for user `352de2fe434b401fb5725743d7beb38d`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:29.561461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0acd4b25-f98c-47b2-8ec1-20c474719fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:29.619565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:29.648572 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1376/2747] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:29.653384 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.726204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357cacf-c4c0-4a45-b848-d910a9f3acc8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.731739 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.732468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.732747 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.733022 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.733719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.735774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.771674 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1372/2748] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:29.773111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd4b25-f98c-47b2-8ec1-20c474719fb4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.784449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd4b25-f98c-47b2-8ec1-20c474719fb4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.839005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.839544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.839847 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.840113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.840733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.842643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.863524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1377/2749] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:29.867670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.878512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9131c-eaa1-427d-9a1c-7c64972c07ff admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.883283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.883986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.884337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.884677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.885396 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.887001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.898458 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1373/2750] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:29.902531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.913430 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4c93-e836-4272-bb01-7188316f4caf admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.918423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea1a7c-b22b-40c6-b592-1d9f0d67bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.919020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea1a7c-b22b-40c6-b592-1d9f0d67bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.919302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea1a7c-b22b-40c6-b592-1d9f0d67bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.919608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea1a7c-b22b-40c6-b592-1d9f0d67bdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.920251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea1a7c-b22b-40c6-b592-1d9f0d67bdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.921964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea1a7c-b22b-40c6-b592-1d9f0d67bdbb admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.932173 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1378/2751] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:29.936621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:29.946628 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2fe81-3ea9-47f9-b9be-f601388fe6c9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:29.951858 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:29.952499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:29.952780 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:29.953057 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] PATH_INFO: `/v3/projects/b2a7ba10a5da45aa840288440261d663/users/f0bb86b1d2b34bfca63ae3d9ebc6142d/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:29.968677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a7ba10a5da45aa840288440261d663, user_id=f0bb86b1d2b34bfca63ae3d9ebc6142d, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:29.971996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:29.989656 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1374/2752] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:29 2022] PUT /identity/v3/projects/b2a7ba10a5da45aa840288440261d663/users/f0bb86b1d2b34bfca63ae3d9ebc6142d/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:29:30.000621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827fb01-097e-4dca-836a-e3962cb1c0d0 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.000621 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827fb01-097e-4dca-836a-e3962cb1c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.000827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827fb01-097e-4dca-836a-e3962cb1c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.029751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-a827fb01-097e-4dca-836a-e3962cb1c0d0 None None] MFA Rules not processed for user `f0bb86b1d2b34bfca63ae3d9ebc6142d`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:30.030976 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-a827fb01-097e-4dca-836a-e3962cb1c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:30.102006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1379/2753] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:30.106821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:30.171619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0c641-180e-4249-9d10-3511357569df admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:30.176512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:30.177116 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.177398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.177670 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.178315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:30.180359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:30.212164 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1375/2754] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:30 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:29:30.213434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827fb01-097e-4dca-836a-e3962cb1c0d0 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:30.224530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827fb01-097e-4dca-836a-e3962cb1c0d0 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:30.274892 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:30.293926 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:30.294549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.294835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.295238 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] PATH_INFO: `/v3/users` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.295912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:30.297912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:30.321818 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1380/2755] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:30 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:30.325722 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:30.332679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:30.336996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290436-2cd6-4732-84d2-83ca21fd0068 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:30.343149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:30.343750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.344033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.344309 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.345531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:30.347324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:30.361874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1376/2756] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:29:30.365964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:30.378265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117a3ef-ddb1-4c9d-9c06-edde48f68024 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:30.383232 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:30.383968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.385035 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.385458 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] PATH_INFO: `/v3/projects/49621f1a095346ec876349a855f315fc/users/c365afef9bf542ab84f26a8b9344195c/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.406874 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49621f1a095346ec876349a855f315fc, user_id=c365afef9bf542ab84f26a8b9344195c, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:30.410530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:30.426506 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1381/2757] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:30 2022] PUT /identity/v3/projects/49621f1a095346ec876349a855f315fc/users/c365afef9bf542ab84f26a8b9344195c/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:30.431533 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:30.443002 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8d77-0426-4d4d-9a91-05db4bf92abb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:30.509894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d52cd-2f8e-44bd-8ecc-45fe1cb58ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:30.510551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d52cd-2f8e-44bd-8ecc-45fe1cb58ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.510825 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d52cd-2f8e-44bd-8ecc-45fe1cb58ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.511121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d52cd-2f8e-44bd-8ecc-45fe1cb58ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.511808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d52cd-2f8e-44bd-8ecc-45fe1cb58ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:30.513435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d52cd-2f8e-44bd-8ecc-45fe1cb58ad3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:30.528956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1377/2758] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:30.530298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:30.542551 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb1fab-f3c6-4ff1-89b3-b52af7b43990 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:30.548775 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:30.549452 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.549731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.550002 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] PATH_INFO: `/v3/projects/49621f1a095346ec876349a855f315fc/users/c365afef9bf542ab84f26a8b9344195c/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.552044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49621f1a095346ec876349a855f315fc, user_id=c365afef9bf542ab84f26a8b9344195c, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:30.554770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:30.566851 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1382/2759] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:30 2022] PUT /identity/v3/projects/49621f1a095346ec876349a855f315fc/users/c365afef9bf542ab84f26a8b9344195c/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:30.578366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.578704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.579529 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.613156 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] MFA Rules not processed for user `c365afef9bf542ab84f26a8b9344195c`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:30.614510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:30.699551 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1378/2760] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:30.711225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:30.713063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:30.779505 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ee7ea-7abd-4241-8931-3887d036e4b4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:30.783890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:30.784507 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:30.784786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:30.785078 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:30.846502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:30.848086 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:30.857750 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1383/2761] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:32.385759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:32.387206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:32.399601 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb672c-be40-45b8-957b-e97780f58db5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:32.403107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:32.403735 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:32.404015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:32.404286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:32.460802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:32.462563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:32.473762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1379/2762] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:32.995856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:33.005351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326e364-e4c2-4572-935d-02cfa3566d4a service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:33.008940 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bf01c-506f-4218-b26e-621b12dca8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:33.009533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf01c-506f-4218-b26e-621b12dca8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:33.009811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf01c-506f-4218-b26e-621b12dca8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:33.010082 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf01c-506f-4218-b26e-621b12dca8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:33.021026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf01c-506f-4218-b26e-621b12dca8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:33.022479 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf01c-506f-4218-b26e-621b12dca8f8 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:33.032938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1384/2763] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:36.946544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:36.960114 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:37.010202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546578f-1dc2-4180-8aa9-0b8252dc1167 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:37.014743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:37.015363 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:37.015685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:37.015951 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] PATH_INFO: `/v3/users/352de2fe434b401fb5725743d7beb38d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:37.017653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352de2fe434b401fb5725743d7beb38d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:37.019618 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:37.065948 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352de2fe434b401fb5725743d7beb38d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.072743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352de2fe434b401fb5725743d7beb38d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.085127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352de2fe434b401fb5725743d7beb38d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.085827 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352de2fe434b401fb5725743d7beb38d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.086464 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352de2fe434b401fb5725743d7beb38d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.099010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1380/2764] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:36 2022] DELETE /identity/v3/users/352de2fe434b401fb5725743d7beb38d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:37.103543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:37.104026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:37.104125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:37.122927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:37.124154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:37.165344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:37.184644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1385/2765] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:37.194772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:37.196315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:37.253001 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286107b5-8803-4d80-afdb-d23abc1ae631 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:37.256629 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:37.257222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:37.257496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:37.257762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:37.266592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:37.268120 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:37.277325 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1381/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:37.537779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:37.539206 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:37.551953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649047e3-d55d-40a7-8e24-3fcec69650be None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:37.557066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:37.557691 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:37.558028 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:37.558327 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] PATH_INFO: `/v3/projects/467d97ccb9d4451cb77a5461472b9c50` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:37.559872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467d97ccb9d4451cb77a5461472b9c50)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:37.561923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:37.610012 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467d97ccb9d4451cb77a5461472b9c50', 'request_id': 'req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.617881 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467d97ccb9d4451cb77a5461472b9c50', 'request_id': 'req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.623579 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467d97ccb9d4451cb77a5461472b9c50', 'request_id': 'req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.634737 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] The token cache is being invalidate because project 467d97ccb9d4451cb77a5461472b9c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:37.635023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.635679 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.637159 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1386/2767] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:37 2022] DELETE /identity/v3/projects/467d97ccb9d4451cb77a5461472b9c50 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:37.641149 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:37.650716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d93c7-0a3f-4e43-ba7f-b5787518bffd service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:37.682919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:37.707633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:37.708252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:37.708526 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:37.708794 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] PATH_INFO: `/v3/users/f0bb86b1d2b34bfca63ae3d9ebc6142d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:37.709900 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bb86b1d2b34bfca63ae3d9ebc6142d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:37.711842 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:37.756738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bb86b1d2b34bfca63ae3d9ebc6142d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.763701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bb86b1d2b34bfca63ae3d9ebc6142d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.776638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bb86b1d2b34bfca63ae3d9ebc6142d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.777361 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bb86b1d2b34bfca63ae3d9ebc6142d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.777966 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bb86b1d2b34bfca63ae3d9ebc6142d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:37.794146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1382/2768] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:37 2022] DELETE /identity/v3/users/f0bb86b1d2b34bfca63ae3d9ebc6142d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:38.060870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:38.062518 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:38.076382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cfdf6-396b-40fc-8fc6-48e2dd1d4853 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:38.139160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:38.139819 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:38.140081 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:38.140351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] PATH_INFO: `/v3/projects/b2a7ba10a5da45aa840288440261d663` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:38.142008 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a7ba10a5da45aa840288440261d663)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:38.144030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:38.197516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a7ba10a5da45aa840288440261d663', 'request_id': 'req-fe063632-40b2-4c01-a25b-3125a1e4a243'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.205647 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a7ba10a5da45aa840288440261d663', 'request_id': 'req-fe063632-40b2-4c01-a25b-3125a1e4a243'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.215964 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a7ba10a5da45aa840288440261d663', 'request_id': 'req-fe063632-40b2-4c01-a25b-3125a1e4a243'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.224074 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:38.231023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] The token cache is being invalidate because project b2a7ba10a5da45aa840288440261d663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:38.231528 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.232624 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.234574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1387/2769] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:38 2022] DELETE /identity/v3/projects/b2a7ba10a5da45aa840288440261d663 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:38.238939 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:38.240406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:38.255596 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3168-0284-4687-991f-0c42a9fde6d6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:38.314777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:38.315437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:38.315717 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:38.315986 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] PATH_INFO: `/v3/users/c365afef9bf542ab84f26a8b9344195c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:38.317094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c365afef9bf542ab84f26a8b9344195c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:38.318999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:38.365184 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c365afef9bf542ab84f26a8b9344195c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.372003 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c365afef9bf542ab84f26a8b9344195c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.373084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:38.386380 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c365afef9bf542ab84f26a8b9344195c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.387032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c365afef9bf542ab84f26a8b9344195c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.387660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2587aef4-ca86-4b71-9e05-79b0e9c66915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c365afef9bf542ab84f26a8b9344195c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.400698 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1383/2770] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:38 2022] DELETE /identity/v3/users/c365afef9bf542ab84f26a8b9344195c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:38.669496 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:38.671061 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:38.684000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe063632-40b2-4c01-a25b-3125a1e4a243 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:38.741746 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:38.742376 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:38.743158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:38.743158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] PATH_INFO: `/v3/projects/49621f1a095346ec876349a855f315fc` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:38.744365 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49621f1a095346ec876349a855f315fc)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:38.746424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:38.792533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49621f1a095346ec876349a855f315fc', 'request_id': 'req-62a85325-700f-4241-8363-39fafa98a078'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.800951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49621f1a095346ec876349a855f315fc', 'request_id': 'req-62a85325-700f-4241-8363-39fafa98a078'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.806966 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49621f1a095346ec876349a855f315fc', 'request_id': 'req-62a85325-700f-4241-8363-39fafa98a078'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.818981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] The token cache is being invalidate because project 49621f1a095346ec876349a855f315fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:38.819262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.819933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-62a85325-700f-4241-8363-39fafa98a078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:38.821427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1388/2771] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:38 2022] DELETE /identity/v3/projects/49621f1a095346ec876349a855f315fc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:38.827651 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89214-aa05-441d-af24-093d28aa6291 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:38.827940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89214-aa05-441d-af24-093d28aa6291 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:38.828216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89214-aa05-441d-af24-093d28aa6291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:38.848921 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-25d89214-aa05-441d-af24-093d28aa6291 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:38.850269 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-25d89214-aa05-441d-af24-093d28aa6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:38.909669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1384/2772] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:38.917692 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344708ea-1a28-4c4f-8d86-2767f6f0c846 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:38.918016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344708ea-1a28-4c4f-8d86-2767f6f0c846 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:38.918290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344708ea-1a28-4c4f-8d86-2767f6f0c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:38.938876 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-344708ea-1a28-4c4f-8d86-2767f6f0c846 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:38.940109 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-344708ea-1a28-4c4f-8d86-2767f6f0c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:38.947920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1389/2773] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:38.952121 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d89214-aa05-441d-af24-093d28aa6291 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:38.961891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d89214-aa05-441d-af24-093d28aa6291 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:38.966575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:38.967176 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:38.967477 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:38.967756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:38.968394 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:29:38.968694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:38.970286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:38.981879 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1385/2774] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:29:38.986662 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344708ea-1a28-4c4f-8d86-2767f6f0c846 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:38.996156 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344708ea-1a28-4c4f-8d86-2767f6f0c846 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:39.001726 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:39.002344 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:39.002617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:39.002880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:39.003543 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:39.005492 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:39.032022 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1390/2775] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:29:38 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:39.036099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:39.046103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac4c48-9eb0-4c85-ab0e-5405972e5eda admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:39.105094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:39.105690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:39.105964 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:39.106235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:39.106870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:39.108806 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:39.143270 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1386/2776] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:29:39 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:29:39.144588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:39.155295 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb1d95-e924-44f8-8cb5-c6225d92f20a admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:39.160570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:39.161561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:39.161561 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:39.161769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:39.162358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:39.164021 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:39.179408 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1391/2777] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:29:39.180693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:39.190461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c98fe-cd91-4546-8cf0-9b213709900b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:39.195100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489865b-3391-4076-b601-4452fcbbc35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:39.195732 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489865b-3391-4076-b601-4452fcbbc35b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:39.196009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489865b-3391-4076-b601-4452fcbbc35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:39.196278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489865b-3391-4076-b601-4452fcbbc35b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:39.196925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489865b-3391-4076-b601-4452fcbbc35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:39.198514 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489865b-3391-4076-b601-4452fcbbc35b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:39.213278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1387/2778] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:29:39.217500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:39.230291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010d470-500b-4d60-9beb-bb4a9f9c3dc1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:39.235113 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:39.236281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:39.236562 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:39.236831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] PATH_INFO: `/v3/projects/9cd70fcbabd442bfb832911525773aec/users/3479d00d142b4490ba489ce72454e3b6/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:39.252212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd70fcbabd442bfb832911525773aec, user_id=3479d00d142b4490ba489ce72454e3b6, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:39.254789 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:39.268981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1392/2779] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:29:39 2022] PUT /identity/v3/projects/9cd70fcbabd442bfb832911525773aec/users/3479d00d142b4490ba489ce72454e3b6/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:39.279461 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8593-0457-4d4a-9314-f779db50c882 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:39.279943 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8593-0457-4d4a-9314-f779db50c882 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:39.280030 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8593-0457-4d4a-9314-f779db50c882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:39.309100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-499a8593-0457-4d4a-9314-f779db50c882 None None] MFA Rules not processed for user `3479d00d142b4490ba489ce72454e3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:39.310321 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-499a8593-0457-4d4a-9314-f779db50c882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:39.340976 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:39.386877 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1388/2780] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:39.398272 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:39.400101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:39.428548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:39.460905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5adcca-c849-454a-ac63-490bb92a47ad admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:39.464708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b9317-7a8e-47da-ab57-933df99ba174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:39.465313 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b9317-7a8e-47da-ab57-933df99ba174 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:39.465590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b9317-7a8e-47da-ab57-933df99ba174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:39.465863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b9317-7a8e-47da-ab57-933df99ba174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:39.475014 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b9317-7a8e-47da-ab57-933df99ba174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:39.476516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b9317-7a8e-47da-ab57-933df99ba174 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:39.486652 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1393/2781] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:44.480865 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8593-0457-4d4a-9314-f779db50c882 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:44.541746 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8593-0457-4d4a-9314-f779db50c882 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:44.546158 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:44.546774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:44.547052 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:44.547342 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] PATH_INFO: `/v3/users/3479d00d142b4490ba489ce72454e3b6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:44.548634 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3479d00d142b4490ba489ce72454e3b6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:44.550520 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:44.594996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3479d00d142b4490ba489ce72454e3b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:44.601728 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3479d00d142b4490ba489ce72454e3b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:44.613489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3479d00d142b4490ba489ce72454e3b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:44.614139 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3479d00d142b4490ba489ce72454e3b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:44.614736 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3479d00d142b4490ba489ce72454e3b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:44.627771 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1389/2782] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:29:44 2022] DELETE /identity/v3/users/3479d00d142b4490ba489ce72454e3b6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:44.632291 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:44.632788 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:44.632887 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:44.651667 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:29:44.652853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:44.712060 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1394/2783] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:29:44.721534 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:44.722931 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:44.778084 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:44.782117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fed58-de92-4f79-806b-4d73a3e11a52 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:44.787225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a2c9-37f6-461a-bad0-7f5ed430238e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:44.787953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a2c9-37f6-461a-bad0-7f5ed430238e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:44.788260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a2c9-37f6-461a-bad0-7f5ed430238e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:44.788558 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a2c9-37f6-461a-bad0-7f5ed430238e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:44.800509 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69a2c9-37f6-461a-bad0-7f5ed430238e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:44.802250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69a2c9-37f6-461a-bad0-7f5ed430238e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:44.813517 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1390/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:45.302182 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:29:45.303763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:29:45.317803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fe733-48bb-47a5-96c3-c159a358c170 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:29:45.323508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:29:45.324466 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:29:45.324749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:29:45.325016 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] PATH_INFO: `/v3/projects/9cd70fcbabd442bfb832911525773aec` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:29:45.326161 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd70fcbabd442bfb832911525773aec)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:29:45.329415 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:29:45.380510 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd70fcbabd442bfb832911525773aec', 'request_id': 'req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:45.388428 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd70fcbabd442bfb832911525773aec', 'request_id': 'req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:45.395934 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd70fcbabd442bfb832911525773aec', 'request_id': 'req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:45.407357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] The token cache is being invalidate because project 9cd70fcbabd442bfb832911525773aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:29:45.407669 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:45.408315 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:29:45.409834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1395/2785] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:29:45 2022] DELETE /identity/v3/projects/9cd70fcbabd442bfb832911525773aec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:29:54.807745 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:29:55.404436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:23.802227 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37c4d-2c19-4396-9730-f543329de665 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:23.802804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37c4d-2c19-4396-9730-f543329de665 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:23.802804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37c4d-2c19-4396-9730-f543329de665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:23.833172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-09d37c4d-2c19-4396-9730-f543329de665 None None] MFA Rules not processed for user `eb9a096eb0524a62919110a6f863351d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:30:23.834687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-09d37c4d-2c19-4396-9730-f543329de665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:23.908329 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1391/2786] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:30:33.906370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=37 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:38.852961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:30:38.854370 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:38.990048 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c800a-1cc5-4abe-9c7c-4f48ec6139ff admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:30:38.995702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:30:38.996409 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:38.996771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:38.997134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:38.999674 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:39.014034 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:30:39.015797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:30:39.027006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1396/2787] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:30:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:30:40.693681 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:40.694125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:40.694220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:40.724103 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] MFA Rules not processed for user `db6463c9c59e408e9d6c81065bae02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:30:40.725302 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:40.788291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1392/2788] 10.222.0.18 () {58 vars in 967 bytes} [Tue Sep 6 04:30:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:30:40.828749 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:30:40.830143 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:40.896401 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f01494-305d-4acd-86d2-458bad2b41fd service placement] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:30:40.901262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7aaf3229ccf44718004798534537abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:30:40.901856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:40.902131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:40.902400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:40.910213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:30:40.911809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:30:40.920057 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1397/2789] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Sep 6 04:30:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 04:30:47.226448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:30:47.228324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:47.337366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970e37-e798-4e57-8d7f-513bfd7877bc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:30:47.342724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:30:47.343338 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:47.343641 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:47.343907 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] PATH_INFO: `/v3/users/5042a155e4184cf29801d66370ec9b93` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:47.345015 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5042a155e4184cf29801d66370ec9b93)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:30:47.346915 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:30:47.392346 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5042a155e4184cf29801d66370ec9b93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.399350 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5042a155e4184cf29801d66370ec9b93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.405040 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:47.413099 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5042a155e4184cf29801d66370ec9b93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.413759 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5042a155e4184cf29801d66370ec9b93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.414356 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5042a155e4184cf29801d66370ec9b93'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.430912 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1393/2790] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:30:47 2022] DELETE /identity/v3/users/5042a155e4184cf29801d66370ec9b93 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:30:47.605319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:30:47.620968 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9626c-aa12-4572-95ce-8acc5d4f9126 service swift] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:30:47.638651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:47.678620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:30:47.679237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:47.679559 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:47.680130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] PATH_INFO: `/v3/projects/64d9df03aad34f84815ae287ad439f3e` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:47.681279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d9df03aad34f84815ae287ad439f3e)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:30:47.683366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:30:47.729870 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d9df03aad34f84815ae287ad439f3e', 'request_id': 'req-520d1e41-a577-423b-a6cd-aece97bf06b7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.736540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d9df03aad34f84815ae287ad439f3e', 'request_id': 'req-520d1e41-a577-423b-a6cd-aece97bf06b7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.742042 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d9df03aad34f84815ae287ad439f3e', 'request_id': 'req-520d1e41-a577-423b-a6cd-aece97bf06b7'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.752643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] The token cache is being invalidate because project 64d9df03aad34f84815ae287ad439f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:30:47.752930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.753548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.754994 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1398/2791] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:30:47 2022] DELETE /identity/v3/projects/64d9df03aad34f84815ae287ad439f3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:30:47.758956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:30:47.760378 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:47.773756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b3e6-4577-4ecb-8de1-65192b459253 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:30:47.829212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:30:47.829917 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:47.830195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:47.830465 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] PATH_INFO: `/v3/users/9db444b533984de0b9d94f8fc09fe4e1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:47.831630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db444b533984de0b9d94f8fc09fe4e1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:30:47.833545 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:30:47.882872 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db444b533984de0b9d94f8fc09fe4e1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.889733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db444b533984de0b9d94f8fc09fe4e1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.901669 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db444b533984de0b9d94f8fc09fe4e1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.902344 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db444b533984de0b9d94f8fc09fe4e1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.902956 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db444b533984de0b9d94f8fc09fe4e1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:47.915590 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1394/2792] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:30:47 2022] DELETE /identity/v3/users/9db444b533984de0b9d94f8fc09fe4e1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:30:48.085601 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:30:48.087102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:30:48.099988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1e41-a577-423b-a6cd-aece97bf06b7 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:30:48.162586 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:30:48.163216 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:30:48.163519 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:30:48.163794 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] PATH_INFO: `/v3/projects/1e67d50a584745138fe026bb23778e3c` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:30:48.164924 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e67d50a584745138fe026bb23778e3c)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:30:48.166844 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:30:48.215603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e67d50a584745138fe026bb23778e3c', 'request_id': 'req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:48.218183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:48.224780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e67d50a584745138fe026bb23778e3c', 'request_id': 'req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:48.232406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e67d50a584745138fe026bb23778e3c', 'request_id': 'req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:48.243770 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] The token cache is being invalidate because project 1e67d50a584745138fe026bb23778e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:30:48.244066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:48.244690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:30:48.246175 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1399/2793] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:30:48 2022] DELETE /identity/v3/projects/1e67d50a584745138fe026bb23778e3c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:30:57.912238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=59,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:58.240919 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:DELETE=3,keystone:SELECT=6 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:27.012278 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.014874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:27.032277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd1736-5e7b-4152-bf37-c4ee9558f8b6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.087234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.088032 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.088313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.088579 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] PATH_INFO: `/v3/users/eb9a096eb0524a62919110a6f863351d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.089672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9a096eb0524a62919110a6f863351d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.092177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.137574 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9a096eb0524a62919110a6f863351d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.144371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9a096eb0524a62919110a6f863351d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.156493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9a096eb0524a62919110a6f863351d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.157159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9a096eb0524a62919110a6f863351d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.157760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f7316f44-7ac6-4dd9-a1b0-5f1fbe8eafa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9a096eb0524a62919110a6f863351d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.170787 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1395/2794] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:27 2022] DELETE /identity/v3/users/eb9a096eb0524a62919110a6f863351d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:31:27.344196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.345617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:27.360464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a08ab-9bdc-4d1f-aa84-977ee81f9539 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.417570 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.418189 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.418464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.418732 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] PATH_INFO: `/v3/projects/fce09015b6434919ae0544039ca4ba64` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.419900 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce09015b6434919ae0544039ca4ba64)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.421805 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.469423 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce09015b6434919ae0544039ca4ba64', 'request_id': 'req-a3981e69-8d4b-4c40-becb-343dee0be4be'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.476604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce09015b6434919ae0544039ca4ba64', 'request_id': 'req-a3981e69-8d4b-4c40-becb-343dee0be4be'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.482134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce09015b6434919ae0544039ca4ba64', 'request_id': 'req-a3981e69-8d4b-4c40-becb-343dee0be4be'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.493187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] The token cache is being invalidate because project fce09015b6434919ae0544039ca4ba64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:31:27.493475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.494115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-a3981e69-8d4b-4c40-becb-343dee0be4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:27.495675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1400/2795] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:27 2022] DELETE /identity/v3/projects/fce09015b6434919ae0544039ca4ba64 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:27.500630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8317b6-c71d-4718-9170-230672f226e5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.500918 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8317b6-c71d-4718-9170-230672f226e5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.501192 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8317b6-c71d-4718-9170-230672f226e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.558225 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cb8317b6-c71d-4718-9170-230672f226e5 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:27.559476 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cb8317b6-c71d-4718-9170-230672f226e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:27.603949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:27.623066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1396/2796] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:27.630969 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dffba-9629-489d-9913-a687c41756fb None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.631249 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dffba-9629-489d-9913-a687c41756fb None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.631576 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dffba-9629-489d-9913-a687c41756fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.651920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-bf9dffba-9629-489d-9913-a687c41756fb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:27.653125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-bf9dffba-9629-489d-9913-a687c41756fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:27.661044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1401/2797] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:27.665128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8317b6-c71d-4718-9170-230672f226e5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.674896 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8317b6-c71d-4718-9170-230672f226e5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.679607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.680206 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.680482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.680754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.681401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:31:27.681705 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.683299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.695193 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1397/2798] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:31:27.699342 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dffba-9629-489d-9913-a687c41756fb None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.709178 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dffba-9629-489d-9913-a687c41756fb None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.713730 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.714307 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.714580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.714863 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.715508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.717403 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.744391 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1402/2799] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:31:27 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:31:27.748807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.758668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382a98-a05a-4542-a692-f48a904e1593 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.815639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.816229 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.816500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.816763 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.817383 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.819261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.840195 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1398/2800] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:31:27 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:31:27.844269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.854636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3295e-6304-4f50-b564-07ac56a75546 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.859135 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.859753 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.860031 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.860298 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.860930 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.862526 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.873364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1403/2801] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:27.877313 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.887012 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663626c-2e03-4501-9ec8-f4eb26bb6945 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.892481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38d449-e3a4-46c2-a8eb-a25cc12938f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.893077 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38d449-e3a4-46c2-a8eb-a25cc12938f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.893354 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38d449-e3a4-46c2-a8eb-a25cc12938f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.893624 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38d449-e3a4-46c2-a8eb-a25cc12938f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.894264 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38d449-e3a4-46c2-a8eb-a25cc12938f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.895891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38d449-e3a4-46c2-a8eb-a25cc12938f9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.905699 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1399/2802] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:27.909516 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:27.919801 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfeffe-f7b7-40f5-ad6e-76b98d74b6c1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:27.924390 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:27.925018 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.925299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.925574 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] PATH_INFO: `/v3/projects/f6bea3d16a284a67b949458bf27b9058/users/92f0fa315d2c4aa1a4ed54f54b5396ad/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.940429 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bea3d16a284a67b949458bf27b9058, user_id=92f0fa315d2c4aa1a4ed54f54b5396ad, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:27.943077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:27.955675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1404/2803] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:27 2022] PUT /identity/v3/projects/f6bea3d16a284a67b949458bf27b9058/users/92f0fa315d2c4aa1a4ed54f54b5396ad/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:27.966788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab4bf5-921d-4f89-b942-4d0be08cc5e5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:27.967069 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab4bf5-921d-4f89-b942-4d0be08cc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:27.967335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab4bf5-921d-4f89-b942-4d0be08cc5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:27.996194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-91ab4bf5-921d-4f89-b942-4d0be08cc5e5 None None] MFA Rules not processed for user `92f0fa315d2c4aa1a4ed54f54b5396ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:27.998017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-91ab4bf5-921d-4f89-b942-4d0be08cc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:28.063234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1400/2804] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:28.067735 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.097683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:28.131703 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1ce5b-6eda-4667-9eb2-ef78abdc5545 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.136279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.136866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.137144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.137413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.138059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.139997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.168884 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1405/2805] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:31:28 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:28.170703 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab4bf5-921d-4f89-b942-4d0be08cc5e5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.184150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab4bf5-921d-4f89-b942-4d0be08cc5e5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.233045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:28.250855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.251414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.251785 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.252039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.252694 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.254614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.276505 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1401/2806] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:31:28 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:28.280541 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.290680 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a0f83-bc5b-4eb8-b0bd-215ff00baefd admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.295905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.296490 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.296765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.297029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.297689 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.299279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.309599 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1406/2807] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:28.314056 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.323908 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96884e-94ab-4ce6-a9df-53089ab4d2f9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.328500 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.329133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.329412 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.329683 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] PATH_INFO: `/v3/projects/ab4c134003c44ccbaebd9a820e438b1a/users/71aff27b88824657a64c96537e709ee8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.344497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4c134003c44ccbaebd9a820e438b1a, user_id=71aff27b88824657a64c96537e709ee8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.347146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.361095 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1402/2808] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:28 2022] PUT /identity/v3/projects/ab4c134003c44ccbaebd9a820e438b1a/users/71aff27b88824657a64c96537e709ee8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:31:28.364909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.375036 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63223-67cf-456c-9eb8-4ef1f8ada56f admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.429297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52701709-6483-4971-8810-fc7b80737595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.429880 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52701709-6483-4971-8810-fc7b80737595 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.430153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52701709-6483-4971-8810-fc7b80737595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.430420 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52701709-6483-4971-8810-fc7b80737595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.431045 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52701709-6483-4971-8810-fc7b80737595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.432670 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52701709-6483-4971-8810-fc7b80737595 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.441988 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1407/2809] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:28.446261 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.458042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dbb4f-575e-428e-b8cc-65b5539fa805 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.462593 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.463228 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.463548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.463829 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] PATH_INFO: `/v3/projects/ab4c134003c44ccbaebd9a820e438b1a/users/71aff27b88824657a64c96537e709ee8/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.465729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4c134003c44ccbaebd9a820e438b1a, user_id=71aff27b88824657a64c96537e709ee8, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.468929 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.479181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1403/2810] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:28 2022] PUT /identity/v3/projects/ab4c134003c44ccbaebd9a820e438b1a/users/71aff27b88824657a64c96537e709ee8/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:28.489858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1d20-46b4-41c7-b3f9-5c64c79cadbe None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.490142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1d20-46b4-41c7-b3f9-5c64c79cadbe None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.490412 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1d20-46b4-41c7-b3f9-5c64c79cadbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.517598 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-9e8b1d20-46b4-41c7-b3f9-5c64c79cadbe None None] MFA Rules not processed for user `71aff27b88824657a64c96537e709ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:28.518722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-9e8b1d20-46b4-41c7-b3f9-5c64c79cadbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:28.585387 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1408/2811] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:28.597181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.598893 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:28.675570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539281-a9b0-4996-b2d7-ae99411c63b8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.679141 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.679756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.680031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.680299 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.689194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.690607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.700752 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1404/2812] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:28.777958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1d20-46b4-41c7-b3f9-5c64c79cadbe None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:28.788463 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1d20-46b4-41c7-b3f9-5c64c79cadbe None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:28.792142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82106d-8245-4a96-be35-454159638457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:28.792763 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82106d-8245-4a96-be35-454159638457 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:28.793039 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82106d-8245-4a96-be35-454159638457 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:28.793305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82106d-8245-4a96-be35-454159638457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:28.812277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:28.851358 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82106d-8245-4a96-be35-454159638457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:28.852809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82106d-8245-4a96-be35-454159638457 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:28.861596 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1409/2813] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:38.695800 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=59,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:38.857549 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=18 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:43.583729 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:43.645287 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8b562-cba4-4533-848d-0b05d32a95a1 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:43.649790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:43.650401 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:43.650677 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:43.650947 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] PATH_INFO: `/v3/users/92f0fa315d2c4aa1a4ed54f54b5396ad` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:43.652070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f0fa315d2c4aa1a4ed54f54b5396ad)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:43.653981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:43.698220 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f0fa315d2c4aa1a4ed54f54b5396ad'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:43.705403 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f0fa315d2c4aa1a4ed54f54b5396ad'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:43.716922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f0fa315d2c4aa1a4ed54f54b5396ad'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:43.717570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f0fa315d2c4aa1a4ed54f54b5396ad'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:43.718169 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f0fa315d2c4aa1a4ed54f54b5396ad'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:43.731548 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1405/2814] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:43 2022] DELETE /identity/v3/users/92f0fa315d2c4aa1a4ed54f54b5396ad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:43.736357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:43.736852 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:43.736961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:43.755627 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:43.756815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:43.813355 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1410/2815] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:43.823089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:43.824497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:43.901776 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21248c63-1fd5-40e7-9a70-d206d757ae87 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:43.905466 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:43.906648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:43.906924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:43.907194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:43.916094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:43.917512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:43.927024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1406/2816] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:44.199811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:44.201243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:44.214130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9ab2-828b-43e9-b3a1-9e08717aa413 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:44.218970 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:44.219643 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:44.219922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:44.220190 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] PATH_INFO: `/v3/projects/f6bea3d16a284a67b949458bf27b9058` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:44.221316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bea3d16a284a67b949458bf27b9058)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:44.223265 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:44.270807 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bea3d16a284a67b949458bf27b9058', 'request_id': 'req-92e2ae1b-0da1-473a-af2c-da5f68d16a63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.278154 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bea3d16a284a67b949458bf27b9058', 'request_id': 'req-92e2ae1b-0da1-473a-af2c-da5f68d16a63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.283709 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bea3d16a284a67b949458bf27b9058', 'request_id': 'req-92e2ae1b-0da1-473a-af2c-da5f68d16a63'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.294779 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] The token cache is being invalidate because project f6bea3d16a284a67b949458bf27b9058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:31:44.295059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.295683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.297205 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1411/2817] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:44 2022] DELETE /identity/v3/projects/f6bea3d16a284a67b949458bf27b9058 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:31:44.301150 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:44.305867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:44.312870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bde15-3877-4617-a5f8-a2c50e1244c8 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:44.368818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:44.369359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:44.369639 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:44.369910 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] PATH_INFO: `/v3/users/71aff27b88824657a64c96537e709ee8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:44.371024 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=71aff27b88824657a64c96537e709ee8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:44.372977 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:44.417750 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71aff27b88824657a64c96537e709ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.425009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71aff27b88824657a64c96537e709ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.436777 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71aff27b88824657a64c96537e709ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.437959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71aff27b88824657a64c96537e709ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.438552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75f4de1a-9c6d-45d3-b8e5-569d01076aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71aff27b88824657a64c96537e709ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.455685 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1407/2818] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:44 2022] DELETE /identity/v3/users/71aff27b88824657a64c96537e709ee8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:44.727185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:44.728626 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:44.742304 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2ae1b-0da1-473a-af2c-da5f68d16a63 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:44.799625 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:44.800255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:44.800530 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:44.800802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] PATH_INFO: `/v3/projects/ab4c134003c44ccbaebd9a820e438b1a` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:44.801913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4c134003c44ccbaebd9a820e438b1a)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:44.803853 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:44.832769 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:44.851063 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4c134003c44ccbaebd9a820e438b1a', 'request_id': 'req-dbbaf673-e477-403f-bedb-92371a6ce249'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.858446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4c134003c44ccbaebd9a820e438b1a', 'request_id': 'req-dbbaf673-e477-403f-bedb-92371a6ce249'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.864713 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4c134003c44ccbaebd9a820e438b1a', 'request_id': 'req-dbbaf673-e477-403f-bedb-92371a6ce249'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.875464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] The token cache is being invalidate because project ab4c134003c44ccbaebd9a820e438b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:31:44.875751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.876374 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-dbbaf673-e477-403f-bedb-92371a6ce249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:44.877834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1412/2819] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:44 2022] DELETE /identity/v3/projects/ab4c134003c44ccbaebd9a820e438b1a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:44.882617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7bc6-b456-4fc9-9dbf-4a65cf8f6e75 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:44.883107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7bc6-b456-4fc9-9dbf-4a65cf8f6e75 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:44.883210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7bc6-b456-4fc9-9dbf-4a65cf8f6e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:44.903123 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-017b7bc6-b456-4fc9-9dbf-4a65cf8f6e75 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:44.904292 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-017b7bc6-b456-4fc9-9dbf-4a65cf8f6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:44.961812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1408/2820] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:44.969986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe390d-ec2c-4543-a78d-d31cbec58a94 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:44.970271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe390d-ec2c-4543-a78d-d31cbec58a94 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:44.970542 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe390d-ec2c-4543-a78d-d31cbec58a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:44.990961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-2dfe390d-ec2c-4543-a78d-d31cbec58a94 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:44.992184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-2dfe390d-ec2c-4543-a78d-d31cbec58a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:45.000013 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1413/2821] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:45.004260 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b7bc6-b456-4fc9-9dbf-4a65cf8f6e75 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.014075 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b7bc6-b456-4fc9-9dbf-4a65cf8f6e75 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.018571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.019178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.019487 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.019757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.020419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:31:45.020716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.022324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.034053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1409/2822] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:31:45.038228 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe390d-ec2c-4543-a78d-d31cbec58a94 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.048033 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe390d-ec2c-4543-a78d-d31cbec58a94 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.052699 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.053299 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.053575 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.053841 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.054460 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.056475 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.084262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1414/2823] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:31:45 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:31:45.088392 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.098862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6effa2-1507-4c5b-93c4-7e92b4e65726 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.103619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:45.154518 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.155043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.155426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.155701 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.156861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.158765 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.178993 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1410/2824] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:31:45 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:45.183245 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.193608 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc6b7b-c21f-48d1-9f95-92bf1bc6acd5 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.198278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.198869 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.199145 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.199453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.200093 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.201685 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.211975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1415/2825] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:45.215793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.226716 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274572-746f-4ee4-b4f4-0ddff9c84f58 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.231691 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c715c-d446-4aaf-8241-0a58f7f9ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.232283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c715c-d446-4aaf-8241-0a58f7f9ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.232563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c715c-d446-4aaf-8241-0a58f7f9ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.232843 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c715c-d446-4aaf-8241-0a58f7f9ad7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.233485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c715c-d446-4aaf-8241-0a58f7f9ad7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.235125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c715c-d446-4aaf-8241-0a58f7f9ad7e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.245588 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1411/2826] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:45.249632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.259508 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656e2ca-a27e-4f42-938e-70e0e1d123ea admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.264155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.264790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.265068 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.265843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] PATH_INFO: `/v3/projects/ddefe2cdbe69490394fb43a8da68946d/users/336e21b0f6bf42ab93e1366969108c12/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.280076 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddefe2cdbe69490394fb43a8da68946d, user_id=336e21b0f6bf42ab93e1366969108c12, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.283340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.295636 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1416/2827] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:45 2022] PUT /identity/v3/projects/ddefe2cdbe69490394fb43a8da68946d/users/336e21b0f6bf42ab93e1366969108c12/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:45.307333 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0212a-713e-49a8-8051-90f5ab4de287 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.307774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0212a-713e-49a8-8051-90f5ab4de287 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.308557 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0212a-713e-49a8-8051-90f5ab4de287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.336919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-24d0212a-713e-49a8-8051-90f5ab4de287 None None] MFA Rules not processed for user `336e21b0f6bf42ab93e1366969108c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:45.338146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-24d0212a-713e-49a8-8051-90f5ab4de287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:45.400202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1412/2828] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:45.404724 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.466302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f350-31fd-46c5-a0af-1080377247f4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.471514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.472136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.472410 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.472684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.473317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.475515 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.502274 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1417/2829] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:31:45 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:45.506371 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0212a-713e-49a8-8051-90f5ab4de287 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.517523 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0212a-713e-49a8-8051-90f5ab4de287 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.571684 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.572279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.572553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.572821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.573447 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.575334 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.597111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1413/2830] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:31:45 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:31:45.601520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.612251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e704f-d265-42dd-88c5-16aec0c93186 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.616906 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.617502 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.617781 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.618052 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.618690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.620328 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.631279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1418/2831] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:45.635280 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.645614 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca083b6-fb76-4b33-86e2-83a9c41be168 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.650107 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.650733 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.651008 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.651277 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] PATH_INFO: `/v3/projects/117fb379f8724af59ee677ee99ab8d68/users/ac053e74fac24ad191483af94807ae00/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.653469 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:45.667335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117fb379f8724af59ee677ee99ab8d68, user_id=ac053e74fac24ad191483af94807ae00, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.669949 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.681770 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1414/2832] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:45 2022] PUT /identity/v3/projects/117fb379f8724af59ee677ee99ab8d68/users/ac053e74fac24ad191483af94807ae00/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:45.685628 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.696200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576903-ce1d-49bd-ad0d-e9f217224de1 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.716158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:45.754504 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3766e4-c6c1-4e2f-8242-02370c642122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.755133 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3766e4-c6c1-4e2f-8242-02370c642122 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.755357 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3766e4-c6c1-4e2f-8242-02370c642122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.755656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3766e4-c6c1-4e2f-8242-02370c642122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.756320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3766e4-c6c1-4e2f-8242-02370c642122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.757912 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3766e4-c6c1-4e2f-8242-02370c642122 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.768067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1419/2833] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:45.772204 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.782293 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c36e7-f648-491b-a691-55eee213eb16 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.787033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.787696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.787973 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.788240 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] PATH_INFO: `/v3/projects/117fb379f8724af59ee677ee99ab8d68/users/ac053e74fac24ad191483af94807ae00/roles/4d01a55cb82849ae8115935ad6f0352a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.790113 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117fb379f8724af59ee677ee99ab8d68, user_id=ac053e74fac24ad191483af94807ae00, role_id=4d01a55cb82849ae8115935ad6f0352a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.792811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:45.802881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1415/2834] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:45 2022] PUT /identity/v3/projects/117fb379f8724af59ee677ee99ab8d68/users/ac053e74fac24ad191483af94807ae00/roles/4d01a55cb82849ae8115935ad6f0352a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:45.813449 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.813728 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.813997 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.841878 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] MFA Rules not processed for user `ac053e74fac24ad191483af94807ae00`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:45.843069 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:45.909494 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1420/2835] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:45.920250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:45.922373 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:45.978273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d74311-a6dc-4385-8b31-75814decd060 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:45.981905 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:45.982493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:45.982766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:45.983038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:45.992622 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:45.994045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:46.004366 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1416/2836] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:46.051350 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:46.052771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:46.065566 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b6511-0cae-405a-8632-9f8e8236e39d None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:46.069201 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75dff-9556-4d41-b0ee-1f65a5f73ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:46.069795 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75dff-9556-4d41-b0ee-1f65a5f73ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:46.070067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75dff-9556-4d41-b0ee-1f65a5f73ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:46.070331 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75dff-9556-4d41-b0ee-1f65a5f73ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:46.126672 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e75dff-9556-4d41-b0ee-1f65a5f73ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:46.128137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e75dff-9556-4d41-b0ee-1f65a5f73ff7 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:46.137120 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1421/2837] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:49.381033 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:49.442497 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebdb4c-90a1-4a41-bd77-ce572cfdb5ac service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:49.447914 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:49.448522 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:49.448802 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:49.449125 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] PATH_INFO: `/v3/users/336e21b0f6bf42ab93e1366969108c12` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:49.450221 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336e21b0f6bf42ab93e1366969108c12)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:49.452159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:49.500088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336e21b0f6bf42ab93e1366969108c12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:49.506772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336e21b0f6bf42ab93e1366969108c12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:49.518564 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336e21b0f6bf42ab93e1366969108c12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:49.519181 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336e21b0f6bf42ab93e1366969108c12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:49.519807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336e21b0f6bf42ab93e1366969108c12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:49.521454 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:49.535276 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1417/2838] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:49 2022] DELETE /identity/v3/users/336e21b0f6bf42ab93e1366969108c12 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:49.539905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:49.540364 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:49.540474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:49.559498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:49.560677 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:49.600293 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:49.619548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1422/2839] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 04:31:49.629243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:49.630636 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:49.687348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488919b-5869-4e0d-9867-799fe3fe1078 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:49.690994 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:49.691621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:49.691901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:49.692172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:49.701039 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:49.703021 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:49.712471 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1418/2840] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:49.977310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:49.978756 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:49.993287 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde741-0e67-4742-8d7b-e93acedfc197 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:49.998194 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:49.998835 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:49.999705 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:49.999989 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] PATH_INFO: `/v3/projects/ddefe2cdbe69490394fb43a8da68946d` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:50.001185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddefe2cdbe69490394fb43a8da68946d)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:50.003083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:50.052010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddefe2cdbe69490394fb43a8da68946d', 'request_id': 'req-b3f05479-7a9e-4652-8004-d52be406f5c2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.060006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddefe2cdbe69490394fb43a8da68946d', 'request_id': 'req-b3f05479-7a9e-4652-8004-d52be406f5c2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.066236 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddefe2cdbe69490394fb43a8da68946d', 'request_id': 'req-b3f05479-7a9e-4652-8004-d52be406f5c2'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.076986 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] The token cache is being invalidate because project ddefe2cdbe69490394fb43a8da68946d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:31:50.077257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.078485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.079984 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1423/2841] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:49 2022] DELETE /identity/v3/projects/ddefe2cdbe69490394fb43a8da68946d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:50.083959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:50.093710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66511-2bb4-48e1-b873-fba206a22ed2 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:50.148855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:50.149460 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:50.149734 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:50.149999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] PATH_INFO: `/v3/users/ac053e74fac24ad191483af94807ae00` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:50.151089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac053e74fac24ad191483af94807ae00)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:50.153017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:50.199668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac053e74fac24ad191483af94807ae00'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.207048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac053e74fac24ad191483af94807ae00'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.219740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac053e74fac24ad191483af94807ae00'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.220405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac053e74fac24ad191483af94807ae00'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.221009 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3de5d489-5550-438a-a192-643ef8594405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac053e74fac24ad191483af94807ae00'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.233375 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1419/2842] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:50 2022] DELETE /identity/v3/users/ac053e74fac24ad191483af94807ae00 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:50.515972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:50.517546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:50.532694 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05479-7a9e-4652-8004-d52be406f5c2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:50.594655 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:50.595319 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:50.595472 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:50.595741 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] PATH_INFO: `/v3/projects/117fb379f8724af59ee677ee99ab8d68` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:50.596848 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=117fb379f8724af59ee677ee99ab8d68)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:50.598774 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:50.648685 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117fb379f8724af59ee677ee99ab8d68', 'request_id': 'req-f49c46b4-4459-40f4-97d0-37f3088a4edb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.656271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117fb379f8724af59ee677ee99ab8d68', 'request_id': 'req-f49c46b4-4459-40f4-97d0-37f3088a4edb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.661916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117fb379f8724af59ee677ee99ab8d68', 'request_id': 'req-f49c46b4-4459-40f4-97d0-37f3088a4edb'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.669246 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:50.675073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] The token cache is being invalidate because project 117fb379f8724af59ee677ee99ab8d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:31:50.675445 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.676324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-f49c46b4-4459-40f4-97d0-37f3088a4edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:50.678337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1424/2843] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:50 2022] DELETE /identity/v3/projects/117fb379f8724af59ee677ee99ab8d68 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:50.683266 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95521be-d0a1-44f3-bd5c-d27c5cd760ed None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:50.683762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95521be-d0a1-44f3-bd5c-d27c5cd760ed None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:50.683980 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95521be-d0a1-44f3-bd5c-d27c5cd760ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:50.704222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e95521be-d0a1-44f3-bd5c-d27c5cd760ed None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:50.705442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e95521be-d0a1-44f3-bd5c-d27c5cd760ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:50.713867 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:50.770873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1420/2844] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:50.833899 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de9ee-cc23-413e-be0b-addf61909aba None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:50.834172 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de9ee-cc23-413e-be0b-addf61909aba None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:50.834442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de9ee-cc23-413e-be0b-addf61909aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:50.857294 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-f07de9ee-cc23-413e-be0b-addf61909aba None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:50.858434 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-f07de9ee-cc23-413e-be0b-addf61909aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:50.868916 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1425/2845] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:50.873217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95521be-d0a1-44f3-bd5c-d27c5cd760ed None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:50.883202 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95521be-d0a1-44f3-bd5c-d27c5cd760ed None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:50.887942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:50.888532 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:50.888807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:50.889076 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:50.890128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:31:50.890435 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:50.892090 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:50.904603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1421/2846] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:31:50.909242 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de9ee-cc23-413e-be0b-addf61909aba None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:50.918513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de9ee-cc23-413e-be0b-addf61909aba None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:50.924464 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:50.925108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:50.925411 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:50.925843 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:50.926520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:50.928540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:50.958176 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1426/2847] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:31:50 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:50.962135 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:50.972741 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1650-799b-4465-a55e-08a7de4afc9f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:51.036999 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:51.037607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.037887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.038157 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.038798 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:51.040812 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:51.064111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1422/2848] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:31:50 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:51.068638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:51.080153 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79f3a-528f-4258-b747-ee676637c88e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:51.084890 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:51.085482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.085757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.086025 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.086659 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:51.088292 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:51.100362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1427/2849] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:51.104502 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:51.116234 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d6a9b-614a-4771-bee9-dbd635e07dae admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:51.121027 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da68b4-1a6c-4d30-9340-047bc5e0467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:51.121649 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da68b4-1a6c-4d30-9340-047bc5e0467a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.121953 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da68b4-1a6c-4d30-9340-047bc5e0467a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.122224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da68b4-1a6c-4d30-9340-047bc5e0467a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.122869 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da68b4-1a6c-4d30-9340-047bc5e0467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:51.124535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da68b4-1a6c-4d30-9340-047bc5e0467a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:51.135138 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1423/2850] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 04:31:51.139157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:51.149513 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22117-09c6-4048-9f69-69a4c85d4bb0 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:51.154115 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:51.154802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.155083 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.156011 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] PATH_INFO: `/v3/projects/986e68ada93f4937aaf9c84e77b8408f/users/f4a7ffdec35e48868ae1b0530149b04c/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.170108 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986e68ada93f4937aaf9c84e77b8408f, user_id=f4a7ffdec35e48868ae1b0530149b04c, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:51.172856 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:51.186110 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1428/2851] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:51 2022] PUT /identity/v3/projects/986e68ada93f4937aaf9c84e77b8408f/users/f4a7ffdec35e48868ae1b0530149b04c/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:51.195982 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564acc-f399-4dab-a998-c6b82783a9d5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.196355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564acc-f399-4dab-a998-c6b82783a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.196585 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564acc-f399-4dab-a998-c6b82783a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.224981 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-30564acc-f399-4dab-a998-c6b82783a9d5 None None] MFA Rules not processed for user `f4a7ffdec35e48868ae1b0530149b04c`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:51.226174 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-30564acc-f399-4dab-a998-c6b82783a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:51.288448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1424/2852] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:51.299476 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:51.301136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:51.357237 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4877-cb2e-45e2-829f-060fdaf1fab2 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:51.360866 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705853f-2d8f-4162-8534-71716ee32780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:51.361457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705853f-2d8f-4162-8534-71716ee32780 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.361731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705853f-2d8f-4162-8534-71716ee32780 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.361993 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705853f-2d8f-4162-8534-71716ee32780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.370181 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705853f-2d8f-4162-8534-71716ee32780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:51.371577 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705853f-2d8f-4162-8534-71716ee32780 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:51.380235 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1429/2853] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:51.399224 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564acc-f399-4dab-a998-c6b82783a9d5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:51.409445 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:51.465372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564acc-f399-4dab-a998-c6b82783a9d5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:51.471070 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:51.471959 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.472235 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.472504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] PATH_INFO: `/v3/users/f4a7ffdec35e48868ae1b0530149b04c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.473638 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a7ffdec35e48868ae1b0530149b04c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:51.475841 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:51.521675 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a7ffdec35e48868ae1b0530149b04c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:51.528474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a7ffdec35e48868ae1b0530149b04c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:51.540066 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a7ffdec35e48868ae1b0530149b04c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:51.540793 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a7ffdec35e48868ae1b0530149b04c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:51.541418 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a7ffdec35e48868ae1b0530149b04c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:51.554319 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1425/2854] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:51 2022] DELETE /identity/v3/users/f4a7ffdec35e48868ae1b0530149b04c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:51.558820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.559127 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.559446 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.579158 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:51.580369 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:51.636578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1430/2855] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:51.646676 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:51.648211 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:51.705970 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e8752-5806-446b-953c-1cc959275d65 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:51.709605 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155d024-4d68-459e-954b-7df611296de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:51.710194 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d024-4d68-459e-954b-7df611296de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:51.710467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d024-4d68-459e-954b-7df611296de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:51.710730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d024-4d68-459e-954b-7df611296de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:51.719482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155d024-4d68-459e-954b-7df611296de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:51.720892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155d024-4d68-459e-954b-7df611296de8 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:51.730563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1426/2856] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:51.989257 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:51.990690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:52.011825 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e283e-15d6-47ad-94d9-d45ef56e1cc8 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.016603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.017351 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.017552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.017828 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] PATH_INFO: `/v3/projects/986e68ada93f4937aaf9c84e77b8408f` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.018975 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986e68ada93f4937aaf9c84e77b8408f)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.020928 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.055129 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:52.073790 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986e68ada93f4937aaf9c84e77b8408f', 'request_id': 'req-b27019be-23f2-403e-a702-77b478b17e34'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:52.080909 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986e68ada93f4937aaf9c84e77b8408f', 'request_id': 'req-b27019be-23f2-403e-a702-77b478b17e34'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:52.086349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986e68ada93f4937aaf9c84e77b8408f', 'request_id': 'req-b27019be-23f2-403e-a702-77b478b17e34'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:52.097605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] The token cache is being invalidate because project 986e68ada93f4937aaf9c84e77b8408f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:31:52.097896 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:52.098511 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b27019be-23f2-403e-a702-77b478b17e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:52.100290 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1431/2857] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:51 2022] DELETE /identity/v3/projects/986e68ada93f4937aaf9c84e77b8408f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:52.105134 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623b7d-38e4-4639-86ef-b4ba20026e69 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.105419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623b7d-38e4-4639-86ef-b4ba20026e69 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.105693 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623b7d-38e4-4639-86ef-b4ba20026e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.126083 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-20623b7d-38e4-4639-86ef-b4ba20026e69 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:52.127283 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-20623b7d-38e4-4639-86ef-b4ba20026e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:52.152480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:52.187767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1427/2858] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:52.195208 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c1c3c-c29c-4f96-b1a0-3bff49607ff4 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.195537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c1c3c-c29c-4f96-b1a0-3bff49607ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.196144 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c1c3c-c29c-4f96-b1a0-3bff49607ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.215961 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-c04c1c3c-c29c-4f96-b1a0-3bff49607ff4 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:52.217160 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c04c1c3c-c29c-4f96-b1a0-3bff49607ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:52.226099 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1432/2859] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:52.230152 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20623b7d-38e4-4639-86ef-b4ba20026e69 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:52.240207 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20623b7d-38e4-4639-86ef-b4ba20026e69 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.244718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.245298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.245571 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.245833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.246468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:31:52.246760 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.248370 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.259531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1428/2860] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:31:52.263722 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c1c3c-c29c-4f96-b1a0-3bff49607ff4 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:52.272771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c1c3c-c29c-4f96-b1a0-3bff49607ff4 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.277361 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.277938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.278215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.278482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.279102 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.281553 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.308215 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1433/2861] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:31:52 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:52.312348 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:52.322127 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96676b09-6bb0-4fd9-8e5c-3bc78b29d002 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.378540 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.379130 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.379439 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.379718 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.380355 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.382267 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.402876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1429/2862] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:31:52 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 04:31:52.407651 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:52.417704 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a0d49-fb9e-4264-b5c9-54444b9a773c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.422922 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.423491 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.423771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.424043 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.424682 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.426269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.436006 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1434/2863] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:52.439790 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:52.450419 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e1278-bc7d-4633-9861-526adea2253c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.455621 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2ab1c-2947-40c6-87d3-eb04d98effbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.456222 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2ab1c-2947-40c6-87d3-eb04d98effbd admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.456499 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2ab1c-2947-40c6-87d3-eb04d98effbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.456768 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2ab1c-2947-40c6-87d3-eb04d98effbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.457408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2ab1c-2947-40c6-87d3-eb04d98effbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.459058 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2ab1c-2947-40c6-87d3-eb04d98effbd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.470110 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1430/2864] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:52.474396 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:52.484971 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ada75-c561-4a06-bad0-031f05cc307c admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.489683 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.490362 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.490661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.490917 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] PATH_INFO: `/v3/projects/01202b8413924227993e86896df2375c/users/22eb194b5d454a14b64d56bfa7046407/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.505745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01202b8413924227993e86896df2375c, user_id=22eb194b5d454a14b64d56bfa7046407, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.508548 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.521827 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1435/2865] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:52 2022] PUT /identity/v3/projects/01202b8413924227993e86896df2375c/users/22eb194b5d454a14b64d56bfa7046407/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:52.533405 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3134d-92ad-4a00-8853-92bae901b580 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.533696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3134d-92ad-4a00-8853-92bae901b580 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.533974 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3134d-92ad-4a00-8853-92bae901b580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.561474 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e2a3134d-92ad-4a00-8853-92bae901b580 None None] MFA Rules not processed for user `22eb194b5d454a14b64d56bfa7046407`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:52.562682 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e2a3134d-92ad-4a00-8853-92bae901b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:52.626389 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1431/2866] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:52.637302 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:52.639071 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:52.695363 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0857-934f-4764-a699-48973e82da74 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:52.699005 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00288b3b-0d9b-4daf-9771-d91221891ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:52.699630 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00288b3b-0d9b-4daf-9771-d91221891ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:52.699911 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00288b3b-0d9b-4daf-9771-d91221891ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:52.700185 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00288b3b-0d9b-4daf-9771-d91221891ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:52.708771 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00288b3b-0d9b-4daf-9771-d91221891ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:52.710203 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00288b3b-0d9b-4daf-9771-d91221891ee6 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:52.719544 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1436/2867] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:58.015861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3134d-92ad-4a00-8853-92bae901b580 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:58.045826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:58.079133 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3134d-92ad-4a00-8853-92bae901b580 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:58.083662 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:58.084285 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.084563 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.084833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] PATH_INFO: `/v3/users/22eb194b5d454a14b64d56bfa7046407` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.085962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22eb194b5d454a14b64d56bfa7046407)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:58.087909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:58.134504 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22eb194b5d454a14b64d56bfa7046407'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.141784 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22eb194b5d454a14b64d56bfa7046407'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.153273 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22eb194b5d454a14b64d56bfa7046407'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.153930 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22eb194b5d454a14b64d56bfa7046407'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.154531 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22eb194b5d454a14b64d56bfa7046407'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.167215 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1432/2868] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:58 2022] DELETE /identity/v3/users/22eb194b5d454a14b64d56bfa7046407 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:58.171765 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.172281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.172394 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.193872 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:58.195101 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:58.247933 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:58.258040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1437/2869] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:58.268094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:58.269481 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:58.326010 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae24cd8-ce9b-4e7e-81b2-e8176793a305 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:58.330223 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dfc23-e822-4c85-89d5-e3023221bba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:58.330813 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dfc23-e822-4c85-89d5-e3023221bba3 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.331088 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dfc23-e822-4c85-89d5-e3023221bba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.331353 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dfc23-e822-4c85-89d5-e3023221bba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.340065 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dfc23-e822-4c85-89d5-e3023221bba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:58.341479 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dfc23-e822-4c85-89d5-e3023221bba3 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:58.350862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1433/2870] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:58.616316 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:58.617768 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:58.630831 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32321e49-a897-4e90-ae0a-b37bd87af3ef None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:58.635873 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:58.636578 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.636951 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.637229 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] PATH_INFO: `/v3/projects/01202b8413924227993e86896df2375c` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.638371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01202b8413924227993e86896df2375c)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:58.640701 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:58.686861 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01202b8413924227993e86896df2375c', 'request_id': 'req-9c56ee6a-782b-4c70-a0d0-077af692a428'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.694179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01202b8413924227993e86896df2375c', 'request_id': 'req-9c56ee6a-782b-4c70-a0d0-077af692a428'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.699840 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01202b8413924227993e86896df2375c', 'request_id': 'req-9c56ee6a-782b-4c70-a0d0-077af692a428'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.710661 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] The token cache is being invalidate because project 01202b8413924227993e86896df2375c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:31:58.710938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.711592 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-9c56ee6a-782b-4c70-a0d0-077af692a428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:58.713111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1438/2871] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:58 2022] DELETE /identity/v3/projects/01202b8413924227993e86896df2375c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:58.717927 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e830d5-6ac1-4acb-97e6-66166cb7b20c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.718210 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e830d5-6ac1-4acb-97e6-66166cb7b20c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.718482 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e830d5-6ac1-4acb-97e6-66166cb7b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.738358 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f7e830d5-6ac1-4acb-97e6-66166cb7b20c None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:58.739594 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f7e830d5-6ac1-4acb-97e6-66166cb7b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:58.783043 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:58.800323 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1434/2872] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:58.808134 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d993d-615e-491e-9bec-6752b014b0bf None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.808432 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d993d-615e-491e-9bec-6752b014b0bf None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.808727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d993d-615e-491e-9bec-6752b014b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.828588 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-771d993d-615e-491e-9bec-6752b014b0bf None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:58.829772 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-771d993d-615e-491e-9bec-6752b014b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:58.837425 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1439/2873] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:58.841493 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e830d5-6ac1-4acb-97e6-66166cb7b20c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:58.851443 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e830d5-6ac1-4acb-97e6-66166cb7b20c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:58.855935 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:58.856528 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.856807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.857079 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.857719 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:31:58.858512 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:58.860175 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:58.871484 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1435/2874] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:31:58.876041 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d993d-615e-491e-9bec-6752b014b0bf None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:58.885283 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d993d-615e-491e-9bec-6752b014b0bf None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:58.889809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:58.890385 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.890657 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.890947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.891604 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:58.893495 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:58.919941 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1440/2875] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:31:58 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:58.924485 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:58.934290 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1a6a-2773-4d59-bc55-10694173d39f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:58.990697 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:58.991301 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:58.991603 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:58.991870 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:58.992507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:58.994430 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:59.014991 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1436/2876] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:31:58 2022] POST /identity/v3/users => generated 280 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:31:59.019192 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:59.029320 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68e9f0-e071-4878-b3e0-3e80c82a696e admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:59.034436 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:59.034958 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.035230 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.035537 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.036170 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:59.037758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:59.048213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1441/2877] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:59.052217 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:59.062352 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766a2fc-885e-402a-89d8-8d9fad34b504 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:59.066963 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd69dc-15ab-457f-bd97-c07c3ae214e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:59.067592 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd69dc-15ab-457f-bd97-c07c3ae214e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.067874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd69dc-15ab-457f-bd97-c07c3ae214e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.068146 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd69dc-15ab-457f-bd97-c07c3ae214e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.068854 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd69dc-15ab-457f-bd97-c07c3ae214e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:59.070448 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd69dc-15ab-457f-bd97-c07c3ae214e7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:59.080933 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1437/2878] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:31:59.084950 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:59.095424 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672918b4-4ec5-4ce2-8c06-06f00f25100b admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:59.100289 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:59.100920 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.101225 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.101498 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] PATH_INFO: `/v3/projects/657917aa369e4554887fd163d9593a3b/users/87592f61aadb4d9d8d383db8a30693ab/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.116278 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657917aa369e4554887fd163d9593a3b, user_id=87592f61aadb4d9d8d383db8a30693ab, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:59.119349 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:59.131512 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1442/2879] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:31:59 2022] PUT /identity/v3/projects/657917aa369e4554887fd163d9593a3b/users/87592f61aadb4d9d8d383db8a30693ab/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:59.141602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c6ce-86c3-4d53-b3d1-db8822917b29 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.141894 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c6ce-86c3-4d53-b3d1-db8822917b29 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.142172 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c6ce-86c3-4d53-b3d1-db8822917b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.169695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7ef3c6ce-86c3-4d53-b3d1-db8822917b29 None None] MFA Rules not processed for user `87592f61aadb4d9d8d383db8a30693ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:59.171584 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ef3c6ce-86c3-4d53-b3d1-db8822917b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:59.234426 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1438/2880] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:59.267255 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:59.269029 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:59.325157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189810-3fe8-4b8a-bd9e-489a2283fde9 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:59.329268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33510bd-693a-48bc-8061-bb75879b8d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:59.329860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33510bd-693a-48bc-8061-bb75879b8d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.330136 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33510bd-693a-48bc-8061-bb75879b8d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.330406 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33510bd-693a-48bc-8061-bb75879b8d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.338469 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33510bd-693a-48bc-8061-bb75879b8d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:59.339953 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33510bd-693a-48bc-8061-bb75879b8d76 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:59.349456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1443/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:59.366808 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3c6ce-86c3-4d53-b3d1-db8822917b29 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:59.412837 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:59.430279 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3c6ce-86c3-4d53-b3d1-db8822917b29 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:59.434885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:59.435553 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.435821 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.436094 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] PATH_INFO: `/v3/users/87592f61aadb4d9d8d383db8a30693ab` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.437257 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87592f61aadb4d9d8d383db8a30693ab)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:59.439200 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:59.490434 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87592f61aadb4d9d8d383db8a30693ab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:59.497197 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87592f61aadb4d9d8d383db8a30693ab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:59.509962 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87592f61aadb4d9d8d383db8a30693ab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:59.510679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87592f61aadb4d9d8d383db8a30693ab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:59.511312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87592f61aadb4d9d8d383db8a30693ab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:31:59.524544 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1439/2882] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:31:59 2022] DELETE /identity/v3/users/87592f61aadb4d9d8d383db8a30693ab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:31:59.529183 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040e33-745c-48ef-81a3-636992b30278 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.529474 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040e33-745c-48ef-81a3-636992b30278 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.529830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040e33-745c-48ef-81a3-636992b30278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.549271 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-16040e33-745c-48ef-81a3-636992b30278 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:31:59.550480 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-16040e33-745c-48ef-81a3-636992b30278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:59.566597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:31:59.609377 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1444/2883] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:31:59.619017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:59.620450 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:59.678940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742af00-a5d5-4109-b993-686bc2adfd1a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:59.682653 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf3cab-661d-4e1b-9571-461218d0588c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:59.683249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf3cab-661d-4e1b-9571-461218d0588c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.683554 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf3cab-661d-4e1b-9571-461218d0588c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.683820 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf3cab-661d-4e1b-9571-461218d0588c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.692510 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf3cab-661d-4e1b-9571-461218d0588c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:59.693919 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf3cab-661d-4e1b-9571-461218d0588c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:31:59.703609 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1440/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:31:59.970527 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16040e33-745c-48ef-81a3-636992b30278 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:31:59.971965 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-16040e33-745c-48ef-81a3-636992b30278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:31:59.984745 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16040e33-745c-48ef-81a3-636992b30278 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:31:59.991786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:31:59.992829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:31:59.992829 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:31:59.993077 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] PATH_INFO: `/v3/projects/657917aa369e4554887fd163d9593a3b` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:31:59.994073 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=657917aa369e4554887fd163d9593a3b)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:31:59.996067 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.043944 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657917aa369e4554887fd163d9593a3b', 'request_id': 'req-b38eec09-0bd3-4137-8232-46c03488f548'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:00.051285 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657917aa369e4554887fd163d9593a3b', 'request_id': 'req-b38eec09-0bd3-4137-8232-46c03488f548'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:00.057219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657917aa369e4554887fd163d9593a3b', 'request_id': 'req-b38eec09-0bd3-4137-8232-46c03488f548'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:00.068784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] The token cache is being invalidate because project 657917aa369e4554887fd163d9593a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:32:00.069091 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:00.069736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-b38eec09-0bd3-4137-8232-46c03488f548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:00.071212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1445/2885] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:31:59 2022] DELETE /identity/v3/projects/657917aa369e4554887fd163d9593a3b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:32:00.076091 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d434f6-5c9b-4537-b780-08427961c7bb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.076617 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d434f6-5c9b-4537-b780-08427961c7bb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.077252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d434f6-5c9b-4537-b780-08427961c7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.099468 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-85d434f6-5c9b-4537-b780-08427961c7bb None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:00.101042 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-85d434f6-5c9b-4537-b780-08427961c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:00.160702 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1441/2886] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:00.168155 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546ec5d-2eab-4ea7-970a-83e9d6ef1e1a None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.168442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546ec5d-2eab-4ea7-970a-83e9d6ef1e1a None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.168717 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546ec5d-2eab-4ea7-970a-83e9d6ef1e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.189341 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-e546ec5d-2eab-4ea7-970a-83e9d6ef1e1a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:00.190540 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-e546ec5d-2eab-4ea7-970a-83e9d6ef1e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:00.198397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1446/2887] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:00.202598 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d434f6-5c9b-4537-b780-08427961c7bb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:00.212413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d434f6-5c9b-4537-b780-08427961c7bb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:00.217036 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:00.217630 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.217906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.218177 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.218818 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:32:00.219163 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:00.220797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.222252 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:00.234975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1442/2888] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:32:00.239103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546ec5d-2eab-4ea7-970a-83e9d6ef1e1a None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:00.248277 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546ec5d-2eab-4ea7-970a-83e9d6ef1e1a None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:00.253564 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:00.254152 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.254431 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.254702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.255335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:00.257268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.283653 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1447/2889] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:32:00 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:32:00.287826 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:00.299975 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc58409-b8e5-48c1-943c-542d298d5c38 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:00.354406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:00.354996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.355275 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.355583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.356203 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:00.358679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.379807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1443/2890] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:32:00 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:32:00.383923 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:00.394459 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f343b2-bbfe-4e8b-ba24-da3569b26965 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:00.399131 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:00.399760 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.400047 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.400318 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.400956 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:00.402560 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.412938 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1448/2891] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:32:00.416687 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:00.426862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a15a7-5b49-4f19-baa5-0f478a5768ad admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:00.431673 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072d65-b144-4876-94e0-60882ebd31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:00.432289 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072d65-b144-4876-94e0-60882ebd31b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.432566 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072d65-b144-4876-94e0-60882ebd31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.432833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072d65-b144-4876-94e0-60882ebd31b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.433496 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072d65-b144-4876-94e0-60882ebd31b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:00.435111 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072d65-b144-4876-94e0-60882ebd31b6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.446118 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1444/2892] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:32:00.450632 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:00.460904 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504ca1-6a36-44fd-9499-71d6f8da4494 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:00.465556 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:00.466188 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.466465 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.466736 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] PATH_INFO: `/v3/projects/4fe5e8f0b9d54177b16f315f4f0229b2/users/ea4e584452c84b048fe5e3d3f956194b/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.482698 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe5e8f0b9d54177b16f315f4f0229b2, user_id=ea4e584452c84b048fe5e3d3f956194b, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:00.485978 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.498455 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1449/2893] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:32:00 2022] PUT /identity/v3/projects/4fe5e8f0b9d54177b16f315f4f0229b2/users/ea4e584452c84b048fe5e3d3f956194b/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:32:00.508788 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ae716-7784-4642-931b-d8da55215603 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.509072 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ae716-7784-4642-931b-d8da55215603 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.509341 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ae716-7784-4642-931b-d8da55215603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.536559 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-616ae716-7784-4642-931b-d8da55215603 None None] MFA Rules not processed for user `ea4e584452c84b048fe5e3d3f956194b`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:00.537754 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-616ae716-7784-4642-931b-d8da55215603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:00.601498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1445/2894] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:00.612990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:00.614707 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:00.659389 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:00.673125 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee2686-ca2a-4623-adbf-0976323ee4df admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:00.676939 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203df6-23d1-40c0-b37e-6c51df400295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:00.677533 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203df6-23d1-40c0-b37e-6c51df400295 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:00.677809 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203df6-23d1-40c0-b37e-6c51df400295 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:00.678079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203df6-23d1-40c0-b37e-6c51df400295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:00.686321 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203df6-23d1-40c0-b37e-6c51df400295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:00.687799 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203df6-23d1-40c0-b37e-6c51df400295 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:00.696793 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1450/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:32:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:32:10.598704 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:10.692523 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=7 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:30.460249 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ae716-7784-4642-931b-d8da55215603 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:30.521738 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ae716-7784-4642-931b-d8da55215603 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:30.526291 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:30.526904 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:30.527178 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:30.527480 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] PATH_INFO: `/v3/users/ea4e584452c84b048fe5e3d3f956194b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:30.530525 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4e584452c84b048fe5e3d3f956194b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:30.532427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:30.578398 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4e584452c84b048fe5e3d3f956194b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:30.585243 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4e584452c84b048fe5e3d3f956194b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:30.596913 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4e584452c84b048fe5e3d3f956194b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:30.597570 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4e584452c84b048fe5e3d3f956194b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:30.598427 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4e584452c84b048fe5e3d3f956194b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:30.610648 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1446/2896] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:32:30 2022] DELETE /identity/v3/users/ea4e584452c84b048fe5e3d3f956194b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:32:30.615151 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:30.615656 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:30.615766 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:30.634569 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:30.635785 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:30.693616 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1451/2897] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:30.704665 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:30.706159 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:30.767892 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2363ed0-6b3b-4a8e-9d49-9bd51ac79070 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:30.772874 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c3a34-c3a1-4607-9d07-4a3dfb91493d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:30.773556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3a34-c3a1-4607-9d07-4a3dfb91493d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:30.773832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3a34-c3a1-4607-9d07-4a3dfb91493d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:30.774100 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3a34-c3a1-4607-9d07-4a3dfb91493d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:30.783580 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c3a34-c3a1-4607-9d07-4a3dfb91493d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:30.784945 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c3a34-c3a1-4607-9d07-4a3dfb91493d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:30.794467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1447/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:32:31.065740 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.067426 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:31.081198 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e7e8-10b7-4c9b-9d8a-8bcc357a3360 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.086792 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.087531 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.087751 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.088023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] PATH_INFO: `/v3/projects/4fe5e8f0b9d54177b16f315f4f0229b2` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.089269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe5e8f0b9d54177b16f315f4f0229b2)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.092040 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.140907 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe5e8f0b9d54177b16f315f4f0229b2', 'request_id': 'req-3d64e8da-6ba2-4598-86a6-794062cd9f1a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:31.147212 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe5e8f0b9d54177b16f315f4f0229b2', 'request_id': 'req-3d64e8da-6ba2-4598-86a6-794062cd9f1a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:31.152731 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe5e8f0b9d54177b16f315f4f0229b2', 'request_id': 'req-3d64e8da-6ba2-4598-86a6-794062cd9f1a'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:31.163317 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] The token cache is being invalidate because project 4fe5e8f0b9d54177b16f315f4f0229b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:32:31.163627 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:31.164243 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-3d64e8da-6ba2-4598-86a6-794062cd9f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:32:31.165702 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1452/2899] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:32:31 2022] DELETE /identity/v3/projects/4fe5e8f0b9d54177b16f315f4f0229b2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:32:31.171180 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfcfec-31ac-4d82-807d-dd7d31025730 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.171495 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfcfec-31ac-4d82-807d-dd7d31025730 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.171797 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfcfec-31ac-4d82-807d-dd7d31025730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.192031 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fddfcfec-31ac-4d82-807d-dd7d31025730 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:31.193238 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fddfcfec-31ac-4d82-807d-dd7d31025730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:31.209706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:31.254362 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1448/2900] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:31.262269 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17c565-f6e2-42c6-a128-0883be710ce9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.262557 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17c565-f6e2-42c6-a128-0883be710ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.262832 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17c565-f6e2-42c6-a128-0883be710ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.282605 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-7a17c565-f6e2-42c6-a128-0883be710ce9 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:31.283842 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-7a17c565-f6e2-42c6-a128-0883be710ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:31.291727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1453/2901] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:31.296672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfcfec-31ac-4d82-807d-dd7d31025730 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.306308 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfcfec-31ac-4d82-807d-dd7d31025730 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.310847 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.311386 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.311672 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.311942 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.312575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 04:32:31.312873 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.314486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.325804 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1449/2902] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Sep 6 04:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 04:32:31.329935 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17c565-f6e2-42c6-a128-0883be710ce9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.339046 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17c565-f6e2-42c6-a128-0883be710ce9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.344279 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.344858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.345130 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.345395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.346055 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.348251 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.384157 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1454/2903] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Sep 6 04:32:31 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:32:31.388345 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.398337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1eec-1f97-400e-a5c7-2f827ab3b9c4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.453891 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.454488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.454767 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.455035 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.455723 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.457660 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.478766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1450/2904] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Sep 6 04:32:31 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 04:32:31.483619 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.493811 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed73e-b5da-446c-ada8-391eb1c54aa4 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.498487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.499070 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.499340 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.499635 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.500268 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.501858 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.511597 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1455/2905] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:32:31.515312 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.525101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387314-78a2-45d3-be20-dd40ed749235 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.530182 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61143863-2d67-4578-bc5a-ac4bb0970504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.530762 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61143863-2d67-4578-bc5a-ac4bb0970504 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.531038 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61143863-2d67-4578-bc5a-ac4bb0970504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.531306 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61143863-2d67-4578-bc5a-ac4bb0970504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.531971 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61143863-2d67-4578-bc5a-ac4bb0970504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.533539 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61143863-2d67-4578-bc5a-ac4bb0970504 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.543724 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1451/2906] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Sep 6 04:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 04:32:31.550224 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.560049 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cabf2-5921-4297-8bab-32dcd0f0e9bb admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.564637 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.565211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.565487 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.565757 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] PATH_INFO: `/v3/projects/37c6b07267244833b95c7e76d33b7474/users/1425a73f984b48e6a5afaffdb58f3b82/roles/08098571657746a1bfa166c6cc1dd6a6` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.580758 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c6b07267244833b95c7e76d33b7474, user_id=1425a73f984b48e6a5afaffdb58f3b82, role_id=08098571657746a1bfa166c6cc1dd6a6)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.583500 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.596219 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1456/2907] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Sep 6 04:32:31 2022] PUT /identity/v3/projects/37c6b07267244833b95c7e76d33b7474/users/1425a73f984b48e6a5afaffdb58f3b82/roles/08098571657746a1bfa166c6cc1dd6a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 04:32:31.601359 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d0917-bdb3-45f7-81b8-c05feea22be7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.601652 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d0917-bdb3-45f7-81b8-c05feea22be7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.601906 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d0917-bdb3-45f7-81b8-c05feea22be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.620315 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a52d0917-bdb3-45f7-81b8-c05feea22be7 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:31.621535 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a52d0917-bdb3-45f7-81b8-c05feea22be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:31.678619 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1452/2908] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:31.688059 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:31.689834 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:31.703602 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:31.747196 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fadd2c-39f1-4846-b6be-201ea6ae8104 admin admin] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:31.750754 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:31.751343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:31.751663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:31.751927 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:31.760603 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:31.762020 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:31.771797 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1457/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:32:32.361575 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107e306-0cd4-418f-8462-64c876f9e952 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:32.361862 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107e306-0cd4-418f-8462-64c876f9e952 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:32.362136 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107e306-0cd4-418f-8462-64c876f9e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:32.390186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5107e306-0cd4-418f-8462-64c876f9e952 None None] MFA Rules not processed for user `1425a73f984b48e6a5afaffdb58f3b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:32.391335 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5107e306-0cd4-418f-8462-64c876f9e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:32.409413 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:32.470772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1453/2910] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:32.482676 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:32.484227 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:32.544397 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998df4b4-66fe-4853-892e-203ffcd89801 service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:32.548310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa181d21ba124c4ba2efd96ddecf5f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:32.548913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:32.549184 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:32.549450 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:32.557802 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:32.559222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:32.571721 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1458/2911] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:32:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:32:33.936089 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c85d9-31d6-4895-8a79-4ea35d6ab1b3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:33.936633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c85d9-31d6-4895-8a79-4ea35d6ab1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:33.936633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c85d9-31d6-4895-8a79-4ea35d6ab1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:33.956556 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-713c85d9-31d6-4895-8a79-4ea35d6ab1b3 None None] MFA Rules not processed for user `1425a73f984b48e6a5afaffdb58f3b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:32:33.957743 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-713c85d9-31d6-4895-8a79-4ea35d6ab1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:33.964408 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1454/2912] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:32:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:32:34.005395 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:34.006778 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:34.061879 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ec7bf-b878-4af2-84ff-cd387a981c62 service cinder] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:34.065427 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b07846b067c4073b5701db6e9232d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:34.066010 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:34.066281 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:34.066547 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:34.068343 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:34.133700 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=100 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:34.150087 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:34.151565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:34.175826 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1459/2913] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:32:35.711507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c85d9-31d6-4895-8a79-4ea35d6ab1b3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:35.721695 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c85d9-31d6-4895-8a79-4ea35d6ab1b3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:35.725538 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54891c63-2174-449c-a582-a4b046268598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:35.726128 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891c63-2174-449c-a582-a4b046268598 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:35.726406 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891c63-2174-449c-a582-a4b046268598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:35.726679 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891c63-2174-449c-a582-a4b046268598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:35.728449 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-54891c63-2174-449c-a582-a4b046268598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:35.742137 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54891c63-2174-449c-a582-a4b046268598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:35.743586 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54891c63-2174-449c-a582-a4b046268598 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:35.754583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1455/2914] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:32:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:32:44.173026 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=10 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:45.749549 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=28 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:32:47.467019 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:32:47.476552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54eb2-4805-4cde-88d9-f8a8e4835cf4 service glance] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:32:47.480187 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:32:47.480815 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:32:47.481072 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:32:47.481335 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:32:47.483023 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:32:47.492305 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:32:47.493707 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:32:47.501641 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1460/2915] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:32:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:32:57.498147 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=6 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:05.617887 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769d23-b5f4-45af-8ff9-3020cf0c6b43 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:05.618456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769d23-b5f4-45af-8ff9-3020cf0c6b43 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:05.618456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769d23-b5f4-45af-8ff9-3020cf0c6b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:05.638054 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-55769d23-b5f4-45af-8ff9-3020cf0c6b43 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:05.639259 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-55769d23-b5f4-45af-8ff9-3020cf0c6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:05.647117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1456/2916] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:05.693839 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:05.697003 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:05.712461 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7bd27-975a-444a-82a1-d8afa8ebb1ef service neutron] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:05.718324 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:05.718913 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:05.719186 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:05.719482 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:05.727580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:05.729784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:05.738955 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1461/2917] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:08.684368 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121e3ff-83f3-4459-9351-a6a8f6ca984a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:08.684901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121e3ff-83f3-4459-9351-a6a8f6ca984a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:08.684901 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121e3ff-83f3-4459-9351-a6a8f6ca984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:08.704268 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a121e3ff-83f3-4459-9351-a6a8f6ca984a None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:08.705463 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a121e3ff-83f3-4459-9351-a6a8f6ca984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:08.713117 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1457/2918] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:08.733638 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:08.735000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:08.749383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75a0e-4e36-450d-9fff-dd3580e38959 service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:08.754681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:08.755266 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:08.755590 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:08.755860 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:08.763725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:08.765286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:08.774383 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1462/2919] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:11.927972 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c083662-43e8-437d-aad7-dddc05552900 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:11.928498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c083662-43e8-437d-aad7-dddc05552900 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:11.928498 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c083662-43e8-437d-aad7-dddc05552900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:11.947472 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0c083662-43e8-437d-aad7-dddc05552900 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:11.948668 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c083662-43e8-437d-aad7-dddc05552900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:11.956421 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1458/2920] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:11.977886 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:11.989990 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c3e8e-2b0d-4710-8ea9-8bfda8911655 service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:11.995539 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:11.996137 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:11.996413 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:11.996681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:12.005213 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:12.006784 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:12.016180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1463/2921] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:15.019456 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77833de1-8c9a-4b83-ace8-9ce9b7ea0bd8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:15.019880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77833de1-8c9a-4b83-ace8-9ce9b7ea0bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:15.020019 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77833de1-8c9a-4b83-ace8-9ce9b7ea0bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:15.039017 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-77833de1-8c9a-4b83-ace8-9ce9b7ea0bd8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:15.040241 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-77833de1-8c9a-4b83-ace8-9ce9b7ea0bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:15.048507 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1459/2922] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:15.069663 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:15.080905 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03ea78-7bdc-4124-a1c1-239f443c3c79 service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:15.086382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:15.086967 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:15.087244 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:15.087552 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:15.095520 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:15.097366 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:15.107382 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1464/2923] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:18.185833 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e76770-90bb-447a-905b-d2b7f16aa098 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:18.186324 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e76770-90bb-447a-905b-d2b7f16aa098 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:18.186442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e76770-90bb-447a-905b-d2b7f16aa098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:18.205620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-26e76770-90bb-447a-905b-d2b7f16aa098 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:18.206815 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-26e76770-90bb-447a-905b-d2b7f16aa098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:18.214597 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1460/2924] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:18.236733 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:18.248286 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43899e-452e-43cf-8b99-254939556abc service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:18.253686 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:18.254211 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:18.254485 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:18.254752 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:18.264400 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:18.265974 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:18.275457 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1465/2925] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:21.340331 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee2db-40bb-454a-a4df-540c4fb88504 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:21.340811 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee2db-40bb-454a-a4df-540c4fb88504 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:21.340925 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee2db-40bb-454a-a4df-540c4fb88504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:21.360096 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ca7ee2db-40bb-454a-a4df-540c4fb88504 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:21.361298 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ca7ee2db-40bb-454a-a4df-540c4fb88504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:21.368909 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1461/2926] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:21.394820 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:21.406311 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e297c0-48a8-4d71-9bbe-5d55452263f3 service nova] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:21.411684 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ca7be-a15a-4e76-8389-56f095b93ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:21.412262 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ca7be-a15a-4e76-8389-56f095b93ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:21.412536 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ca7be-a15a-4e76-8389-56f095b93ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:21.412803 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ca7be-a15a-4e76-8389-56f095b93ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:21.420617 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ca7be-a15a-4e76-8389-56f095b93ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:21.422179 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ca7be-a15a-4e76-8389-56f095b93ed0 service nova] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:21.431620 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1466/2927] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:31.054620 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ee2db-40bb-454a-a4df-540c4fb88504 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:31.061633 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=19 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:31.069690 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ee2db-40bb-454a-a4df-540c4fb88504 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:31.075766 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:31.076486 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:31.076796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:31.077085 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:31.079440 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:31.093214 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:31.094816 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:31.106583 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1462/2928] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:31.427583 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=36 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:35.380725 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:35.381337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:35.381337 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:35.400333 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] MFA Rules not processed for user `1425a73f984b48e6a5afaffdb58f3b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:35.401535 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:35.408303 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1467/2929] 10.222.0.18 () {58 vars in 958 bytes} [Tue Sep 6 04:33:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:35.878591 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:35.880051 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:35.891318 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b14ff-6d51-43a3-8d0a-dba1dafc648c service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:35.894884 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf28e8b35a8246778b66c59164947add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:35.895501 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:35.895778 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:35.896045 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:35.897706 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:35.906757 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:35.908786 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:35.916552 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1463/2930] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:36.239096 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:36.240546 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:36.317111 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ed4d-9747-4b44-9337-53e09a2ab3b9 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:36.322142 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebddbe8-8c29-4127-973c-1b5754a1e8eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:36.322742 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebddbe8-8c29-4127-973c-1b5754a1e8eb service placement] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:36.323024 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebddbe8-8c29-4127-973c-1b5754a1e8eb service placement] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:36.323297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebddbe8-8c29-4127-973c-1b5754a1e8eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:36.325032 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-4ebddbe8-8c29-4127-973c-1b5754a1e8eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:36.336222 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebddbe8-8c29-4127-973c-1b5754a1e8eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:36.337830 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebddbe8-8c29-4127-973c-1b5754a1e8eb service placement] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:36.348339 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1468/2931] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:33:43.654212 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:43.669074 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8d725-4dfc-41a2-a960-81e43023fc81 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:43.674903 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:43.675546 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:43.675830 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:43.676101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:43.677835 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:43.690459 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:43.692078 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:43.703186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1464/2932] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 04:33:46.343310 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=35 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:47.541422 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f5526-4f47-4e02-99ed-fbdd000fed32 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:47.542027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f5526-4f47-4e02-99ed-fbdd000fed32 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:47.542027 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f5526-4f47-4e02-99ed-fbdd000fed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:47.562103 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-842f5526-4f47-4e02-99ed-fbdd000fed32 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:47.563308 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-842f5526-4f47-4e02-99ed-fbdd000fed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:47.571044 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1469/2933] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:47.591297 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:47.604073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95212f7-236d-4442-a953-2c8a002befb7 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:47.609657 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:47.610242 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:47.610515 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:47.610807 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:47.620093 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:47.621696 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:47.631131 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1465/2934] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:50.796946 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc27d-029b-4a79-b8ed-bc173f34a660 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:50.797453 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc27d-029b-4a79-b8ed-bc173f34a660 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:50.797567 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc27d-029b-4a79-b8ed-bc173f34a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:50.817442 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-0ddbc27d-029b-4a79-b8ed-bc173f34a660 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:50.818675 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-0ddbc27d-029b-4a79-b8ed-bc173f34a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:50.826443 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1470/2935] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:50.848861 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:50.860109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbade832-3d0c-4c3b-97ba-cdc2ba392b46 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:50.865730 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:50.866316 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:50.866589 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:50.866855 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:50.875286 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:50.876880 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:50.886644 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1466/2936] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:53.886594 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168124f8-247a-4b18-898a-a279fc630308 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:53.887088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168124f8-247a-4b18-898a-a279fc630308 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:53.887200 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168124f8-247a-4b18-898a-a279fc630308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:53.906673 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-168124f8-247a-4b18-898a-a279fc630308 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:53.907897 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-168124f8-247a-4b18-898a-a279fc630308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:53.915644 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1471/2937] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:53.936115 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:53.947876 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc663-bc20-4dec-9355-e9f61e892c4a service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:53.953330 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:53.953940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:53.954216 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:53.954489 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:53.962607 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:53.964250 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:53.973834 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1467/2938] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:33:57.050297 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35067-86d9-4a4e-9dc2-f61a13256758 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:57.050822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35067-86d9-4a4e-9dc2-f61a13256758 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:57.050822 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35067-86d9-4a4e-9dc2-f61a13256758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:57.070360 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-70a35067-86d9-4a4e-9dc2-f61a13256758 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:33:57.071568 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-70a35067-86d9-4a4e-9dc2-f61a13256758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:33:57.079169 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1472/2939] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:33:57.100772 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:33:57.112109 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19640e-8be6-41be-8579-bb52d79f5532 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:33:57.118186 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:33:57.118774 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:33:57.119126 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:33:57.119429 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:33:57.127542 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:33:57.129727 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:33:57.138996 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1468/2940] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:34:00.213180 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] REQUEST_METHOD: `POST` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:34:00.213727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:34:00.213727 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:34:00.233371 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.auth.core [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] MFA Rules not processed for user `6fc7d729120c446b975c63cfa06003cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81627) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 04:34:00.234571 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:34:00.243079 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1473/2941] 10.222.0.23 () {58 vars in 1016 bytes} [Tue Sep 6 04:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 04:34:00.269442 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:34:00.280885 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df6f35-be8d-4bc5-bc42-1d7004546c22 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:34:00.286940 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88339d0387834b8b8e833579efd7ee96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:34:00.287600 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:34:00.287881 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:34:00.288151 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:34:00.296483 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:34:00.298053 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:34:00.308048 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1469/2942] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:34:10.228524 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=15 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:34:10.303832 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=47 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:34:27.993456 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:34:27.995000 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:34:28.009857 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb99cc-510d-4220-99f2-f4336c9e68a8 None None] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:34:28.014780 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:34:28.015392 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] REQUEST_METHOD: `GET` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:34:28.015681 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:34:28.015947 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:34:28.017648 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.fernet_utils [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81627) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:34:28.029435 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:34:28.031030 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:34:28.042981 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1474/2943] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:34:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:34:28.051602 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:34:28.064124 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010605-d9ba-4193-b11a-d0711ba57e62 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:34:28.069148 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:34:28.069801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:34:28.070073 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:34:28.070337 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] PATH_INFO: `/v3/users/1425a73f984b48e6a5afaffdb58f3b82` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:34:28.071467 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1425a73f984b48e6a5afaffdb58f3b82)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:34:28.073414 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:34:28.118924 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1425a73f984b48e6a5afaffdb58f3b82'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.125740 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1425a73f984b48e6a5afaffdb58f3b82'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.137437 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1425a73f984b48e6a5afaffdb58f3b82'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.138101 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1425a73f984b48e6a5afaffdb58f3b82'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.138710 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1425a73f984b48e6a5afaffdb58f3b82'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.151756 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1470/2944] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Sep 6 04:34:28 2022] DELETE /identity/v3/users/1425a73f984b48e6a5afaffdb58f3b82 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:34:28.325094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] Authenticating user token {{(pid=81627) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:34:28.335565 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528376ba-dc43-40f0-8e1f-556e2d988b29 service placement] Validating token access rules against request {{(pid=81627) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:34:28.393918 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc7d729120c446b975c63cfa06003cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7e04b96ebc74904845e65316dbf81fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81627) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:34:28.394538 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:34:28.394837 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:34:28.395088 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] PATH_INFO: `/v3/projects/37c6b07267244833b95c7e76d33b7474` {{(pid=81627) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:34:28.396223 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c6b07267244833b95c7e76d33b7474)` {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:34:28.398708 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] RBAC: Authorization granted {{(pid=81627) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:34:28.444514 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c6b07267244833b95c7e76d33b7474', 'request_id': 'req-52ce3fe7-c93f-404d-9ec8-ce363ed99997'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.451580 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c6b07267244833b95c7e76d33b7474', 'request_id': 'req-52ce3fe7-c93f-404d-9ec8-ce363ed99997'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.457066 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c6b07267244833b95c7e76d33b7474', 'request_id': 'req-52ce3fe7-c93f-404d-9ec8-ce363ed99997'} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.469690 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] The token cache is being invalidate because project 37c6b07267244833b95c7e76d33b7474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81627) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 04:34:28.469972 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.470595 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG keystone.notifications [None req-52ce3fe7-c93f-404d-9ec8-ce363ed99997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81627) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 04:34:28.472094 dv-cinder-856002-1-smb devstack@keystone.service[81627]: [pid: 81627|app: 0|req: 1475/2945] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Sep 6 04:34:28 2022] DELETE /identity/v3/projects/37c6b07267244833b95c7e76d33b7474 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 04:34:38.148488 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:34:38.466786 dv-cinder-856002-1-smb devstack@keystone.service[81627]: DEBUG dbcounter [-] [81627] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:37.572187 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 04:36:37.573623 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:36:37.643425 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf689df-6c9b-4ea0-85ee-296885cc1c92 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 04:36:37.701922 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726a20-349b-4c4a-b1de-2c0b59f6baf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd74e1c4445439fa55b53f56f2befce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c451f44fb2d4403c97f1c6bd42584fd1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 04:36:37.702524 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726a20-349b-4c4a-b1de-2c0b59f6baf8 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 04:36:37.702796 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726a20-349b-4c4a-b1de-2c0b59f6baf8 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 04:36:37.703059 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726a20-349b-4c4a-b1de-2c0b59f6baf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 04:36:37.704819 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-53726a20-349b-4c4a-b1de-2c0b59f6baf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 04:36:37.715801 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726a20-349b-4c4a-b1de-2c0b59f6baf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 04:36:37.717372 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726a20-349b-4c4a-b1de-2c0b59f6baf8 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 04:36:37.726938 dv-cinder-856002-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1471/2946] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Sep 6 04:36:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 04:36:47.722779 dv-cinder-856002-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=58 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}